Senior Data Engineer - Governance
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSGCPApache KafkaAzureData engineeringSparkTerraform
Requirements
- Solid experience in data engineering, with a strong focus on architecture design, scalable data platforms, and distributed systems
- Deep knowledge of data lake/lakehouse ecosystems, including tools such as Delta Lake, Apache Iceberg, or Apache Hudi
- Hands-on experience with cloud infrastructure and services across AWS, Azure, or GCP environments
- Proficiency in infrastructure as code using tools like Terraform or CloudFormation
- Strong understanding of big data processing and performance tuning using technologies such as Apache Spark and Apache Kafka
- Experience with data storage formats such as Parquet and Avro, including optimization techniques for performance and cost
- Knowledge of containerized or distributed environments such as Kubernetes
- Strong analytical mindset, problem-solving ability, and capacity to work in high-complexity environments
- Excellent communication skills and ability to collaborate with cross-functional technical teams
Responsibilities
- Design and propose end-to-end data pipeline architectures (e.g., Lambda, Kappa, ETL, streaming or scraping-based solutions)
- Define and implement modern data lake and lakehouse architectures using technologies such as Delta Lake, Apache Iceberg, or Apache Hudi
- Oversee cloud infrastructure decisions and guide best practices across platforms such as Amazon Web Services, Microsoft Azure, or Google Cloud Platform
- Identify and resolve performance bottlenecks across data systems, optimizing distributed processing frameworks and storage layers
- Lead incident response for complex data issues, implementing root-cause solutions and proactive monitoring strategies
- Ensure strong data governance practices, including cataloging, lineage, and access control
- Improve storage efficiency and data processing performance through partitioning strategies, compression formats, and query optimization
View Full Description & ApplyYou'll be redirected to the employer's site
