Senior Data Engineer

C
Coconut SoftwareFinancial technology
Opportunity to work remote - anywhere in Canada!ContractSenior
Salary125,000 - 165,000 CAD per year
Apply NowOpens the employer's application page

Job Details

Experience
5+ years in data engineering, including 2+ years running Databricks in production
Required Skills
PythonSQLTerraformdbtDatabricks

Requirements

  • Have 5+ years of data engineering experience, including 2+ years running Databricks in production.
  • Have production experience with Delta, Jobs, DLT/Lakeflow, and Unity Catalog.
  • Bring strong Python, SQL, and dbt skills.
  • Have experience replicating from operational databases using CDC or events, and ingesting messy files.
  • Have participated in at least one warehouse or lakehouse migration.
  • Be comfortable with AWS data services.
  • Have handled PII or regulated data; financial services experience is ideal.
  • Have hands-on experience with AI coding agents such as Claude Code for pipelines, dbt, debugging, or troubleshooting.
  • Have experience with Infrastructure-as-Code such as Terraform or DAB for managing data infrastructure.
  • Experience with LookML or embedded Looker is listed as an additional qualification.
  • Experience managing pipelines that feed forecasting or ML models is listed as an additional qualification.

Responsibilities

  • Build and run production pipelines in Databricks using Lakeflow, Jobs, and dbt, from customer-file ingestion through tables for models and reporting.
  • Lead the next phases of the Redshift-to-Databricks migration, including landing source tables, moving product analytics onto the lakehouse, and retiring old warehouses.
  • Own replication and ingestion from production databases across multiple environments using AWS DMS, Databricks Lakeflow Connect, and Fivetran.
  • Build data residency and PII handling into replication and ingestion workflows.
  • Set data contracts with internal teams and external ML partners to prevent downstream breakage from schema changes.
  • Provide product teams with effort estimates and trade-offs, and push back on scope when needed.
  • Monitor pipeline health, data quality, and Databricks cost, and participate in the Data on-call rotation.
  • Document runbooks, lineage, and design decisions so the team can manage the systems.
View Full Description & ApplyYou'll be redirected to the employer's site
125,000 - 165,000 CAD per year
Apply Now