Data Engineer (Databricks + Fabric)
New
J
JobgetherData engineering
Work remotely from BrazilFull-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Professional English proficiency at B2 level or above; Fluent Spanish
- Required Skills
- PythonSQLCI/CDDatabricksPySpark
Requirements
- Have proven hands-on experience implementing and managing Databricks solutions in production; proof of concept or theoretical experience alone is insufficient.
- Have strong experience with PySpark, Delta Lake, Databricks Workflows, and Unity Catalog, including catalog management, permissions, and data lineage.
- Have production experience designing and implementing Medallion architectures with Bronze, Silver, and Gold layers.
- Have hands-on experience across Microsoft Fabric, including Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Warehouse; proof of concept experience alone is insufficient.
- Demonstrate advanced proficiency in SQL and Python.
- Understand modern data engineering, lakehouse architectures, data governance, and production data platform management.
- Have experience building and maintaining automated deployment workflows using CI/CD and Infrastructure as Code.
- Hold a current Microsoft DP-900 or DP-700 certification and commit to obtaining the remaining certification within the first 60 days of employment; certification must be verifiable through Microsoft Learn.
- Have professional English proficiency at B2 level or above.
- Be fluent in Spanish for professional discussions and client interactions.
- Demonstrate analytical and problem-solving skills and a practical, hands-on approach to implementation.
Responsibilities
- Design, develop, deploy, and maintain production-grade data platforms for clients.
- Build and optimize ETL/ELT pipelines using Databricks and Microsoft Fabric.
- Design and implement Medallion lakehouse architectures with Bronze, Silver, and Gold layers using Delta Lake.
- Develop data processing solutions with PySpark, Python, SQL, Databricks Workflows, and Microsoft Fabric components.
- Implement and manage Unity Catalog governance, including permissions, access controls, lineage, and data quality practices.
- Use Microsoft Fabric Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Warehouse capabilities.
- Establish and automate deployment processes using CI/CD pipelines and Infrastructure as Code.
- Gather and translate business and technical requirements with clients and internal teams.
- Identify improvements to data architectures, infrastructure, and engineering workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
