Senior Fabric Data Engineer
New
S
Spirit OmegaData Engineering
Toronto, Ontario, CanadaContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonSQLGitAzureData modelingAzure DevOpsPySpark
Requirements
- 7+ years of experience in data engineering and enterprise data integration.
- Strong hands-on experience with Microsoft Fabric and related Azure data services.
- Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
- Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
- Experience with curated data layers, data modeling, and analytics-ready datasets.
- Experience tuning data pipelines for scale, resiliency, and cost optimization.
- Working knowledge of security, access controls, and data governance practices.
- Experience with Azure DevOps and Git-based deployment automation.
- Strong analytical, troubleshooting, and communication skills.
- Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
Responsibilities
- Design and implement robust data solutions using Microsoft Fabric, including OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks.
- Build and optimize scalable ingestion and transformation pipelines using PySpark, Python, and SQL across structured and unstructured datasets.
- Migrate and harmonize data from legacy source systems including Saba, Cura, and related enterprise platforms.
- Develop API-driven and scheduled workflows to ingest data from internal and external systems and support downstream processing.
- Implement business rules for learning history, completion status, certifications, compliance, skills, and learner profile data.
- Build curated and consumption-ready datasets/models for analytics, dashboards, and operational reporting.
- Perform SQL development and tuning for reporting, analytics, and downstream consumption.
- Implement automated data quality checks, reconciliations, monitoring, exception handling, and audit logging.
- Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns.
- Support CI/CD, code promotion, release management, and operational monitoring in Agile delivery.
View Full Description & ApplyYou'll be redirected to the employer's site
