Lead Data Consultant (Microsoft Fabric)
New
T
Trility ConsultingData engineering
At this time, Trility is only able to hire W2 employees who reside in the following states: Alabama, Colorado, Delaware, Florida, Georgia, Iowa, Kansas, Kentucky, Louisiana, Minnesota, Missouri, Montana, Nebraska, Nevada, North Carolina, Ohio, South Carolina, Tennessee, Texas, Virginia, and Wisconsin.Full-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse
- Required Skills
- SQLDatabricksGitHub ActionsPySpark
Requirements
- 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse.
- Hands-on Microsoft Fabric production experience with lakehouses, pipelines, notebooks, medallion architecture, workspaces, and capacity management.
- Strong experience building and maintaining production ETL/ELT pipelines and reusable data ingestion frameworks.
- Demonstrated experience designing metadata-driven ingestion frameworks with configuration-based onboarding and extensible processing patterns.
- Experience developing Spark notebooks and data transformation workflows using PySpark and Spark SQL.
- Strong SQL skills for transformation, validation, and performance tuning, including understanding existing T-SQL logic.
- Experience analyzing Azure Synapse pipelines and complex data-processing dependencies.
- Experience implementing Bronze, Silver, and Gold medallion architecture patterns.
- Experience designing Git-based CI/CD workflows for data platform artifacts using GitHub Actions, Azure DevOps, or similar tools.
- Hands-on Claude Code experience for AI-assisted development, including directing code generation and critically reviewing generated code.
- Experience validating data migrations and data quality across source and target systems.
- Experience integrating REST APIs, relational databases, and structured or semi-structured data sources.
- Familiarity with data governance, lineage, metadata management, and data catalog concepts.
Responsibilities
- Evaluate and refine Microsoft Fabric architecture, metadata structures, table-level event triggering, and reusable ingestion patterns.
- Design and implement a metadata-driven ingestion framework for configuration-based onboarding of tables and sources.
- Migrate prioritized data sources and workloads from Azure Synapse into Microsoft Fabric.
- Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL.
- Analyze Azure Synapse pipelines and dependencies, and translate existing processing logic into Fabric solutions.
- Build validation and reconciliation processes, including duplicate detection, key alignment, and record-level comparisons.
- Analyze source loading requirements and recommend full-load, incremental, or change data capture patterns.
- Implement Git-based CI/CD and automated environment promotion for Fabric artifacts using GitHub Actions, Azure DevOps, or similar tools.
- Use Claude Code to specify implementations, accelerate development, and review generated code.
- Collaborate with client engineers through paired development, code reviews, and knowledge-sharing sessions.
View Full Description & ApplyYou'll be redirected to the employer's site
