Senior Data Engineer
New
B
Blip Global Data Engineering
Location: Remote - BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLApache AirflowHadoopKafkaAzureSparkRESTful APIsScala
Requirements
- Bachelor's degree in Exact Sciences (Computer Science, Engineering, Mathematics, etc.).
- Solid experience in Data Engineering.
- Advanced knowledge of Microsoft Azure architecture services and features.
- Experience with parallel processing and messaging technologies (Hadoop, Spark, Kafka, etc.).
- Mastery of data ingestion, integration, and orchestration tools (Data Factory, Airflow, etc.).
- Experience with large volume file storage environments (HDFS, Blob Storages, Data Lake, etc.).
- Excellent command of relational databases (queries, programming, modeling, and performance).
- Proficiency in programming languages (Python, Spark and/or Scala).
- Experience with building and maintaining REST APIs and Azure Cloud Functions.
- Ability to communicate technical decisions clearly and influence stakeholders.
Responsibilities
- Lead the design and implementation of robust pipelines for large-scale data ingestion and processing, in batch and streaming.
- Define data architecture patterns, including partitioning, versioning, security, and governance.
- Ensure reliability, quality, and traceability of data through observability, monitoring, automated testing, and Data Quality practices.
- Act as a technical contact for product and business stakeholders, translating strategic needs into scalable solutions.
- Evaluate and recommend technologies and frameworks for the data stack.
- Perform diagnostics and optimizations of performance and cost in queries, jobs, storage, and orchestration.
- Support the team's technical development through code reviews, mentoring, and knowledge dissemination.
- Collaborate with other disciplines to integrate end-to-end solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
