Lead Data Engineer (Microsoft Fabric & Azure)

HSO India Pvt. Ltd.Data engineering

Location: India; Remote / Work From HomeFull-TimeLead

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Experience: 10+ years of experience in Data Engineering / Data Platform development.
Required Skills: PythonSQLMicrosoft AzurePySpark

Have 10+ years of experience in data engineering or data platform development.
Have strong hands-on experience with Microsoft Fabric; this is mandatory.
Have strong hands-on experience with Microsoft Azure data services; this is mandatory.
Have hands-on experience with Fabric Data Factory, Fabric Lakehouse, and Fabric Data Warehouse, and understand OneLake.
Have experience with data pipelines, notebooks, Dataflows Gen2, and Fabric architecture and workspace management.
Have experience with Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Azure SQL.
Have experience with Azure Databricks, Azure Storage, Azure Functions or Logic Apps, and Azure Key Vault, monitoring, and security services.
Have strong SQL and database development skills, and experience with Python and/or PySpark.
Understand ETL/ELT, data warehousing, dimensional modelling, Lakehouse architecture, and batch and real-time processing.
Have experience with APIs, structured and unstructured data sources, Git, CI/CD, and DevOps practices.
Have knowledge of data security, governance, lineage, and data quality, and experience troubleshooting and optimizing complex data pipelines.
Have a bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related field.

Lead the design and development of enterprise-grade data engineering solutions using Microsoft Fabric and Azure.
Design scalable data pipelines for batch and real-time data processing.
Develop and optimize ETL/ELT processes using Azure and Microsoft Fabric technologies.
Work with Fabric Data Factory, Lakehouse, Data Warehouse, OneLake, and related Fabric components.
Design solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure SQL, and other Azure data services.
Develop data ingestion, transformation, cleansing, and integration processes from multiple source systems.
Implement data models and data warehouse solutions for analytics and reporting.
Optimize data pipelines, queries, storage, and processing performance.
Establish data quality, security, governance, and monitoring practices.
Collaborate with architects, BI developers, and business stakeholders; mentor data engineering teams and support solution design, code reviews, troubleshooting, and production support.

View Full Description & ApplyYou'll be redirected to the employer's site