Senior Data Engineer GCP/DBT
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGCPGitTerraformBigQuerydbtPySpark
Requirements
- Strong hands-on experience with Google Cloud Platform (GCP), including BigQuery, Cloud Storage, and Dataproc
- Proven experience with dbt and data transformation workflows
- Advanced knowledge of SQL
- Solid experience with Python and PySpark
- Experience designing and optimizing distributed data processing pipelines and data lake/lakehouse architectures
- Knowledge of orchestration tools such as Dataflow, Composer, or similar
- Experience with Infrastructure as Code (Terraform)
- Knowledge of cloud security concepts (IAM, VPC, networking)
- Familiarity with Git/GitFlow and agile development methodologies
- Strong analytical and problem-solving skills
- Experience with monitoring, debugging, and maintaining production data systems
Responsibilities
- Design, build, and maintain scalable data pipelines and architectures on GCP using services such as BigQuery, Cloud Storage, and Dataproc
- Develop ELT/ETL workflows using tools like dbt, Dataflow, or Spark (PySpark) to process and transform large datasets
- Define and optimize data models, including partitioning and clustering strategies in BigQuery
- Implement Infrastructure as Code (Terraform) to provision and manage cloud resources
- Ensure data quality, governance, and security through IAM policies
- Monitor, troubleshoot, and optimize data pipelines, jobs, and queries
- Collaborate with stakeholders to define architecture standards and documentation
View Full Description & ApplyYou'll be redirected to the employer's site
