Senior Data Engineer
New
G
Grupo QuintoAndarReal Estate
Our technology team operates under a "remote-first" model, which means we work from home and can live anywhere in Brazil.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 7 or more years of experience in Data Engineering roles
- Required Skills
- AWSPythonSQLHadoopKubernetesAirflowSparkDatabricks
Requirements
- 7 or more years of experience in Data Engineering roles.
- Expertise in Big Data technologies (Spark, Hadoop, Hive, MapReduce).
- Proficiency in Python and YAML.
- Experience with Airflow, AWS, and Databricks.
- Strong foundation in software engineering principles.
- Experience with columnar storage and data lakehouse concepts.
- Strong knowledge in optimizing SQL query performance.
- Experience in building multidimensional data models (Star/Snowflake schema).
- Knowledge in infrastructure (Kubernetes, ECS, CI/CD, Terraform, Prometheus, Grafana).
- Proficiency in English.
- Experience as a tech/project lead.
Responsibilities
- Build and maintain a high-performance data platform.
- Create and edit data pipelines, considering business logic and data quality.
- Create data modeling and transformation workflows.
- Responsible for the entire code development lifecycle (deployment, documentation, performance, security, monitoring).
- Investigate inconsistencies and trace data source differences.
- Enable teams across the company to access and use data more effectively.
- Align with stakeholders to understand their primary needs and propose scalable solutions.
- Conduct PoCs and benchmarks to determine the best tool for a problem.
View Full Description & ApplyYou'll be redirected to the employer's site
