Senior Data Engineer
C
Coconut SoftwareFinancial technology
Opportunity to work remote - anywhere in Canada!ContractSenior
Salary125,000 - 165,000 CAD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years in data engineering, including 2+ years running Databricks in production
- Required Skills
- PythonSQLTerraformdbtDatabricks
Requirements
- Have 5+ years of data engineering experience, including 2+ years running Databricks in production.
- Have production experience with Delta, Jobs, DLT/Lakeflow, and Unity Catalog.
- Bring strong Python, SQL, and dbt skills.
- Have experience replicating from operational databases using CDC or events, and ingesting messy files.
- Have participated in at least one warehouse or lakehouse migration.
- Be comfortable with AWS data services.
- Have handled PII or regulated data; financial services experience is ideal.
- Have hands-on experience with AI coding agents such as Claude Code for pipelines, dbt, debugging, or troubleshooting.
- Have experience with Infrastructure-as-Code such as Terraform or DAB for managing data infrastructure.
- Experience with LookML or embedded Looker is listed as an additional qualification.
- Experience managing pipelines that feed forecasting or ML models is listed as an additional qualification.
Responsibilities
- Build and run production pipelines in Databricks using Lakeflow, Jobs, and dbt, from customer-file ingestion through tables for models and reporting.
- Lead the next phases of the Redshift-to-Databricks migration, including landing source tables, moving product analytics onto the lakehouse, and retiring old warehouses.
- Own replication and ingestion from production databases across multiple environments using AWS DMS, Databricks Lakeflow Connect, and Fivetran.
- Build data residency and PII handling into replication and ingestion workflows.
- Set data contracts with internal teams and external ML partners to prevent downstream breakage from schema changes.
- Provide product teams with effort estimates and trade-offs, and push back on scope when needed.
- Monitor pipeline health, data quality, and Databricks cost, and participate in the Data on-call rotation.
- Document runbooks, lineage, and design decisions so the team can manage the systems.
View Full Description & ApplyYou'll be redirected to the employer's site