Databricks Engineer
New
V
V4CData engineering
Workable workplace: remote; Workable locations: CanadaContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLCI/CDdbtPySpark
Requirements
- Bring expert-level SQL skills.
- Have extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt.
- Write clean, maintainable Python scripts for data manipulation, automation, and API integrations.
- Have practical experience using PySpark for data transformation and basic performance tuning, including joins and the DataFrame API.
- Understand Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations.
- Have strong troubleshooting skills and a methodical approach to identifying root causes and validating fixes.
- Have experience owning pipelines end to end, including CI/CD deployment, monitoring, and handling schema drift.
- Communicate problems and results clearly and concisely in written and spoken communication.
Responsibilities
- Build, optimize, and maintain data pipelines using SQL, dbt, and Python.
- Implement data-quality checks and automated testing frameworks within dbt.
- Monitor production workflows and manage alerts.
- Debug pipeline failures, identify root causes, and implement permanent fixes.
- Write PySpark transformations for large-scale datasets in a Lakehouse environment.
- Translate data issues into clear action plans for technical teammates and business stakeholders.
View Full Description & ApplyYou'll be redirected to the employer's site
