Grupo QuintoAndar | Senior Data Platform Engineer

View full description

Requirements:

• Knowledge in Big Data technologies (Spark, Hive, MapReduce) and programming languages (YAML, Python).
• Proficiency in Python or a main programming language with a focus on clean and maintainable code.
• Understanding of data lifecycle concepts (lineage, governance, privacy, retention, anonymization).
• Excellent communication skills for collaboration across teams.
• Familiarity with large-scale data platforms, cloud resources (AWS, GCP), Apache Airflow, and data lakehouse concepts.

Responsibilities:

• Build and maintain a high-performance data platform that meets the company's needs and promotes analytical innovation.
• Responsible for the entire code development lifecycle, including monitoring deployment and ensuring compliance.
• Align with stakeholders to understand their needs while providing scalable and incremental solutions.
• Conduct PoCs and benchmarks to determine the best tools for specific problems.
• Contribute to defining the strategic vision by collaborating across teams to address challenges.