Data Engineer, Data Platform
New
BrazilFull-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLKafkaKubernetesData engineeringSparkTerraform
Requirements
- Strong experience as a Data Engineer, Analytics Engineer, Data Platform Engineer, or similar role.
- Proficiency in Python and SQL, with experience in building production-grade data pipelines.
- Experience working with modern cloud data platforms (AWS preferred; GCP or Azure also valued).
- Solid understanding of data architectures such as data warehouses, data lakes, and lakehouse models.
- Experience with distributed data processing and large-scale data systems.
- Ability to design and build reliable, idempotent, and well-documented data workflows.
- Strong problem-solving skills with the ability to handle ambiguous technical challenges independently.
- Experience working in cross-functional engineering environments with strong communication skills.
- Experience with Kafka, Kinesis, Flink, Spark, Kubernetes/EKS, Terraform, and open table formats like Apache Iceberg, Delta Lake, or Hudi.
- Familiarity with data governance, observability, and building data APIs.
Responsibilities
- Design, build, and evolve scalable data pipelines supporting ingestion, transformation, and consumption across the platform.
- Own end-to-end data engineering initiatives, from architecture design to production deployment and monitoring.
- Support the migration and evolution toward a modern data lakehouse architecture using open table formats.
- Develop and optimize batch and streaming data processing systems for large-scale event ingestion.
- Contribute to the design and improvement of data modeling, storage strategies, and consumption layers.
- Work with cloud-based infrastructure to ensure performance, reliability, and scalability of data systems.
- Collaborate with cross-functional teams to define data needs, standards, and best practices.
- Participate in on-call rotation and support operational stability of critical data platform components.
View Full Description & ApplyYou'll be redirected to the employer's site