Grupo QuintoAndar | Data Engineer
Company:Grupo QuintoAndar
Location:Brazil
Languages:English
Skills:
AWSDockerPythonSQLETLKubernetesAirflowData engineeringData scienceGrafanaPrometheusSparkCI/CDTerraformData modelingSoftware Engineering
Requirements:
Knowledge in Big Data technologies, solutions, and concepts (Spark, Hive, MapReduce) Experience with Airflow, Spark, AWS and Databricks Strong foundation in software engineering principles, with experience working on data-centric systems Proficiency in Python, or one of the main programming languages Strong knowledge in optimizing SQL query performance Experience in building multidimensional data models (Star and/or Snowflake schema) Understanding of the data lifecycle and related concepts Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS) Excellent communication skills
Responsibilities:
Build and maintain a high-performance data platform Create and edit data pipelines considering business logic Create data modeling and transformation workflows Manage the entire code development lifecycle Investigate data inconsistencies and trace sources Enable self-service data access for company teams Align with stakeholders to understand needs and propose solutions Conduct PoCs and benchmarks for tool selection Contribute to defining strategic vision Advocate for data analytics and engineering value
