Senior Data Engineer
New
G
Grupo QuintoAndarReal Estate Tech
Our technology team operates under a "remote-first" model, which means we work from home and can live anywhere in Brazil.Full-TimeSenior
SalaryCompetitive salary
Apply NowOpens the employer's application page
Job Details
- Languages
- Proficiency in English
- Experience
- 7 or more years of experience in Data Engineering roles
- Required Skills
- AWSPythonSQLHadoopAirflowData engineeringSparkTerraformData modelingDatabricks
Requirements
- 7 or more years of experience in Data Engineering roles.
- Expertise in Big Data technologies: Spark, Hadoop, Hive, MapReduce.
- Proficiency in Python and YAML.
- Experience with Airflow, AWS, and Databricks.
- Strong foundation in software engineering principles for data-centric systems.
- Experience with columnar storage and data lakehouse concepts.
- Advanced knowledge in SQL query performance optimization.
- Experience building multidimensional data models (Star and/or Snowflake schema).
- Knowledge of infrastructure (Kubernetes, ECS), CI/CD, Terraform, and observability (Prometheus, Grafana).
- Professional proficiency in English.
- Experience as a tech/project lead or similar.
Responsibilities
- Build and maintain a high-performance data platform to connect product solutions and enable analytical innovation.
- Create and manage data pipelines by handling aggregation, grouping, data quality checks, and cleaning.
- Develop data modeling and transformation workflows for accessible data abstractions.
- Manage the entire code development lifecycle including deployment, documentation, security, and performance monitoring.
- Investigate data inconsistencies and conduct root-cause troubleshooting.
- Enable company-wide self-service data access through well-modeled datasets.
- Conduct PoCs and benchmarks to determine optimal tools and architectural solutions.
- Define strategic vision across team and service boundaries.
View Full Description & ApplyYou'll be redirected to the employer's site
