Grupo QuintoAndar | Data Engineer

Posted 24 days agoViewed
BrazilFull-TimeReal Estate Technology
Company:Grupo QuintoAndar
Location:Brazil
Languages:English
Skills:
AWSDockerPythonSQLETLKubernetesAirflowData engineeringData scienceGrafanaPrometheusSparkCI/CDTerraformData modelingSoftware Engineering
Requirements:
Knowledge in Big Data technologies, solutions, and concepts (Spark, Hive, MapReduce) and multiple languages (YAML, Python) Experience with Airflow, Spark, AWS and Databricks Strong foundation in software engineering principles, with experience working on data-centric systems Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code Strong knowledge in optimizing SQL query performance Has experience in building multidimensional data models (Star and/or Snowflake schema) Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc. Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others Excellent communication skills, proactively sharing and collaborating with both technical and non-technical stakeholders to translate business needs into scalable data solutions Curiosity, detail-orientation, and thrive in a fast-paced, data-driven environment
Responsibilities:
Build and maintain a high-performance data platform Create and edit data pipelines, considering business logic, data quality, and transformations Create data modeling and transformation workflows Responsible for the entire code development lifecycle Investigate inconsistencies and trace the source of differences (data troubleshooting) Enable teams to access and use data more effectively through self-service tools Align with stakeholders to understand needs and propose extensible, scalable, and incremental solutions Conduct PoCs and benchmarks to determine the best tool for a given problem Contribute to defining the strategic vision Advocating for the value of data analytics and engineering within the organization and fostering a data-driven culture
Similar Jobs:
Posted about 2 months ago
BrazilFull-TimeReal Estate Technology
Grupo QuintoAndar | Staff Security Engineer (Data Security)
Posted 4 months ago
BrazilFull-TimeReal Estate
Grupo QuintoAndar | Senior Software Engineer
Posted 23 days ago
BrazilFull-TimeReal Estate Technology
Grupo QuintoAndar | Senior Machine Learning Engineer