Engenheiro de Dados
New
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLAirflowSparkCI/CDPySpark
Requirements
- Solid hands-on experience with AWS data services (S3, Glue, Redshift, Athena, Lambda, IAM, CloudWatch, Step Functions).
- Strong knowledge of SQL, Python, and/or PySpark.
- Experience building and managing data pipelines using modern orchestration tools like Airflow.
- Deep understanding of modern data architectures (Data Lake, Lakehouse, Data Warehouse).
- Experience with data integration from APIs, event-driven systems, and heterogeneous data sources.
- Familiarity with CI/CD, version control, and automation.
- Strong analytical and problem-solving skills.
Responsibilities
- Develop, maintain, and optimize end-to-end data pipelines, including ingestion, transformation, and integration.
- Design and implement modern data architectures such as Data Lake, Lakehouse, and Data Warehouse solutions on AWS.
- Build and orchestrate scalable workflows using tools like AWS Glue, Apache Spark, Airflow, or equivalent.
- Ensure data quality, consistency, security, and availability across all data platforms.
- Participate in technical discussions and architectural decisions for cloud-based data solutions.
- Integrate data from APIs, streaming systems, and various databases.
- Support version control, CI/CD pipelines, and automation practices.
View Full Description & ApplyYou'll be redirected to the employer's site
