Engenheiro de Dados (GCP/Databricks)
New
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- Minimum of 4 years
- Required Skills
- PythonSQLETLGCPAirflowSparkData modelingBigQueryDatabricksPySpark
Requirements
- Minimum of 4 years of experience as a Data Engineer working with large-scale data systems.
- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, and Dataflow.
- Solid experience with Databricks and Apache Spark (PySpark) for distributed data processing.
- Advanced knowledge of Python and SQL for data engineering tasks.
- Experience in data modeling, including relational and dimensional modeling approaches.
- Experience with orchestration tools such as Airflow or similar workflow management systems.
- Familiarity with Git and modern version control practices.
- Strong analytical thinking, problem-solving skills, and ability to work in collaborative, agile environments.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines across cloud environments, ensuring performance, reliability, and maintainability.
- Build and optimize data processing solutions using Databricks (Spark/PySpark) for large-scale distributed workloads.
- Work on ingestion, transformation, and availability of data using Google Cloud Platform services such as BigQuery, Cloud Storage, and Dataflow.
- Design and evolve data architectures including Data Lake, Data Warehouse, and Lakehouse models.
- Integrate diverse data sources such as APIs, relational databases, and streaming systems.
- Ensure data quality, governance, security, and compliance across all data pipelines and datasets.
- Monitor and optimize system performance and cloud resource usage to improve efficiency and reduce costs.
- Collaborate with BI, Analytics, and Data Science teams to enable data-driven decision-making.
View Full Description & ApplyYou'll be redirected to the employer's site
