Engenheiro de Dados Sênior Databricks/DBT
J
JobgetherSecurity & IT
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- Minimum 4 years
- Required Skills
- PythonSQLGitSparkTerraformDatabricksGitHub Actions
Requirements
- Minimum 4 years of hands-on experience with dbt Core, including incremental models, macros, and tests.
- Minimum 4 years of practical experience with Databricks, including Unity Catalog, SQL Warehouses, and Delta Lake.
- Strong knowledge of Apache Spark and distributed data processing.
- Advanced SQL and Python skills for developing maintainable data solutions.
- Practical experience implementing CI/CD for data pipelines using GitHub Actions.
- Experience with Databricks Asset Bundles for packaging and deploying components.
- Strong Git experience with collaborative development practices.
- Experience with cloud computing (GCP preferred; AWS or Azure acceptable).
- Strong engineering mindset regarding automated testing, version control, and reproducible deployments.
- Familiarity with Terraform and Infrastructure as Code.
- Knowledge of dimensional modeling (Kimball/star schema) or Data Vault.
Responsibilities
- Design and implement the dbt platform architecture on Databricks, including Unity Catalog and medallion architecture.
- Establish DBT project standards covering data modeling, testing, and documentation.
- Build and maintain CI/CD pipelines for data projects using GitHub Actions.
- Automate infrastructure provisioning and platform operations using Terraform and Databricks Asset Bundles.
- Optimize data-platform performance and costs across clusters, SQL Warehouses, and incremental processing.
- Develop and maintain Databricks Workflows for reliable data-pipeline orchestration.
- Define and implement data governance and security practices using Unity Catalog.
- Mentor team members in analytical engineering practices and maintain high technical quality.
View Full Description & ApplyYou'll be redirected to the employer's site
