Senior Data Consultant
New
T
Trility ConsultingData Consulting
Work remotely anywhere in the United StatesContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- SQLSparkDatabricksAzure DevOps
Requirements
- 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse.
- Hands-on Microsoft Fabric experience in production environments.
- Strong experience building and maintaining ETL/ELT pipelines.
- Experience developing Spark notebooks and data transformation workflows.
- Experience implementing medallion architecture patterns (Bronze, Silver, Gold).
- Strong SQL skills for data transformation, validation, and performance tuning.
- Experience integrating data from REST APIs, relational databases, XML, CSV, and other structured or semi-structured data sources.
- Experience working with Azure DevOps CI/CD processes.
- Familiarity with data governance, lineage, and metadata management concepts.
- Experience working within lakehouse architectures and cloud-based analytics platforms.
- Strong written and verbal communication skills.
Responsibilities
- Build and maintain Microsoft Fabric data pipelines supporting REST APIs, SQL Server sources, and file-based ingestion processes.
- Develop and orchestrate Spark notebooks within Microsoft Fabric.
- Implement Bronze, Silver, and Gold lakehouse patterns within OneLake environments.
- Develop ingestion processes that accommodate schema drift and evolving source systems.
- Design reusable ingestion frameworks and scalable data engineering patterns.
- Build, test, and optimize ETL/ELT processes for performance, scalability, and maintainability.
- Support the implementation of semantic models, Direct Lake solutions, and downstream analytics requirements.
- Participate in Azure DevOps CI/CD processes, including Dev/Test/Prod promotion workflows.
- Implement metadata, lineage, governance, and security best practices.
- Collaborate closely with client engineers through paired development and knowledge-sharing activities.
View Full Description & ApplyYou'll be redirected to the employer's site
