Senior Data Engineer (BI)
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 2–3+ years
- Required Skills
- AWSDockerPythonSQLApache AirflowETLKubernetesMachine LearningData engineeringCI/CD
Requirements
- 2–3+ years of experience as a Data Engineer or ML Engineer in production-grade environments.
- Strong systems thinking approach, with the ability to design scalable and reliable data architectures.
- Solid expertise in AWS services (S3, Glue, Athena, Redshift, Lambda, EC2, RDS, EMR, VPC, ECS/EKS).
- Proficiency in Python (object-oriented programming) and advanced SQL optimization.
- Experience with Apache Airflow for workflow orchestration.
- Familiarity with CI/CD practices using GitHub Actions or GitLab.
- Knowledge of Docker and Kubernetes (EKS/ECS, ECR).
- Strong focus on performance, scalability, and cost optimization.
- High attention to detail, strong documentation habits, and a commitment to engineering excellence.
Responsibilities
- Architect and scale robust ETL pipelines using modern big data and cloud-native technologies to support analytics and machine learning use cases.
- Design and maintain end-to-end data workflows, covering data ingestion, transformation, orchestration, and model deployment.
- Develop and manage Airflow-based workflows for reliable and automated data processing.
- Optimize large-scale datasets and complex SQL queries to improve performance and efficiency.
- Operationalize machine learning models in both batch and real-time environments.
- Improve scalability and cost-efficiency across cloud data infrastructure, primarily within AWS environments.
- Strengthen data governance frameworks, monitoring systems, and data quality standards.
- Build internal data tools and solutions that empower analytics and marketing science teams.
View Full Description & ApplyYou'll be redirected to the employer's site
