Senior Data Consultant (Microsoft Fabric)
New
T
Trility ConsultingData engineering
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse
- Required Skills
- SQLDatabricksGitHub ActionsAzure DevOpsPySpark
Requirements
- Have 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse.
- Have hands-on Microsoft Fabric experience in production, including lakehouses, pipelines, notebooks, medallion architecture, workspaces, and capacity management.
- Have experience building and maintaining production ETL/ELT pipelines and reusable data ingestion frameworks.
- Have experience designing and implementing metadata-driven ingestion frameworks, including configuration-based onboarding and extensible processing patterns.
- Have experience developing Spark notebooks and data transformation workflows using PySpark and Spark SQL.
- Have strong SQL skills for transformation, validation, and performance tuning, including the ability to read existing T-SQL logic.
- Have experience working with Azure Synapse, analyzing existing pipelines, and understanding complex data processing dependencies.
- Have experience implementing medallion architecture patterns (Bronze, Silver, Gold).
- Have experience designing and implementing Git-based CI/CD workflows using GitHub Actions, Azure DevOps, or similar tooling.
- Have hands-on experience using Claude Code for AI-assisted development, including directing code generation and critically reviewing generated code.
- Have experience validating data migrations and ensuring data quality, accuracy, and consistency across source and target systems.
- Have experience integrating data from REST APIs, relational databases, and structured or semi-structured data sources.
Responsibilities
- Evaluate and refine the existing Microsoft Fabric architecture, including metadata structures, table-level event triggering, and reusable ingestion patterns.
- Design and implement a metadata-driven ingestion framework for configuration-based onboarding of tables and sources.
- Migrate prioritized data sources and workloads from Azure Synapse into Microsoft Fabric.
- Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL.
- Analyze Azure Synapse pipelines and translate existing processing logic and dependencies into Fabric solutions.
- Build data validation and reconciliation processes to verify migration accuracy.
- Analyze source-specific loading requirements and recommend full-load, incremental, or change data capture patterns.
- Implement Git-based CI/CD and automated environment promotion for Fabric artifacts.
- Use Claude Code to define implementation specifications, accelerate development, and review AI-generated code.
- Collaborate with client engineers through paired development, code reviews, and knowledge-sharing sessions.
View Full Description & ApplyYou'll be redirected to the employer's site
