Senior Data Engineer
New
CanadaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonSQLCloud ComputingAirflowData engineering
Requirements
- 7+ years of experience in data engineering or related technical roles.
- University degree in computer science, engineering, mathematics, or a related discipline.
- Strong hands-on expertise with Azure Databricks, Python notebooks, and SQL development.
- Extensive experience with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure SQL, Airflow, Unity Catalog, and Lakeflow.
- Proven experience building and managing scalable data pipelines, orchestration frameworks, and API service layers.
- Strong understanding of enterprise-grade software engineering practices and reusable framework development.
- Experience designing solutions capable of processing multi-million record datasets.
- Ability to integrate AI capabilities into software development processes through automation.
- Strong stakeholder management, communication, and facilitation skills.
Responsibilities
- Design, develop, and maintain scalable data engineering solutions using Azure Databricks, Python, SQL, and cloud data platforms.
- Build and optimize automated data ingestion, transformation, notebook execution, job scheduling, and deployment processes across Azure-based environments.
- Develop and maintain data pipelines, API services, orchestration workflows, and reusable engineering frameworks.
- Implement best practices for enterprise-grade software development, automation, and modern data engineering methodologies.
- Partner with operations teams to integrate automated and self-service processes for data pipeline, notebook, and API service releases.
- Drive the adoption of AI-enabled development practices, including reusable prompts, skills, instructions, and agents.
- Collaborate with technology and business teams to understand data requirements and deliver solutions aligned with organizational objectives.
- Support governance, risk management, compliance initiatives, and enterprise data platform standards.
View Full Description & ApplyYou'll be redirected to the employer's site
