Lead Data Architect (Fabric)
J
JobgetherEnterprise data platforms
Fully remote working arrangement, open to candidates anywhere in India.Full-TimeLead
Salary2,000,000 - 6,000,000 INR per year
Apply NowOpens the employer's application page
Job Details
- Experience
- Minimum 8 years of overall professional experience is mandatory, with 10+ years preferred in data engineering, data warehousing, or cloud data platform development. At least 4 years of hands-on experience with Microsoft Azure Data Platform technologies. Minimum 2 years of practical experience implementing and managing Microsoft Fabric solutions in enterprise environments.
- Required Skills
- PythonSQLMicrosoft AzureSparkCI/CDDatabricksAzure DevOpsPySpark
Requirements
- Hold a Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related discipline.
- Have at least 8 years of overall professional experience; 10+ years in data engineering, data warehousing, or cloud data platform development is preferred.
- Have at least 4 years of hands-on experience with Microsoft Azure Data Platform technologies.
- Have at least 2 years of practical experience implementing and managing Microsoft Fabric solutions in enterprise environments.
- Demonstrate hands-on expertise in Microsoft Fabric components, including OneLake, Lakehouse, Data Warehouse, Data Factory, Data Engineering, Power BI, and Real-Time Intelligence.
- Be proficient in Databricks, PySpark, SQL, Python, and Apache Spark, including optimisation of large-scale data processing workloads.
- Have experience designing enterprise data architectures, scalable ETL/ELT pipelines, dimensional data models, and cloud-based data warehouses.
- Have practical experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, source control, CI/CD pipelines, and deployment automation.
- Understand data governance, enterprise security, access management, regulatory compliance, and cloud architecture principles.
- Demonstrate the ability to lead complex data engineering initiatives, modernise legacy platforms, and deliver scalable cloud-native enterprise solutions.
- Be familiar with Agile/Scrum delivery methodologies and cross-functional technical teams.
Responsibilities
- Lead the architecture, design, and implementation of enterprise-scale Microsoft Fabric solutions, defining technical direction, engineering standards, reusable frameworks, and adoption practices.
- Own unified data ecosystem architecture, including OneLake structures, workspace strategies, capacity planning, domain segregation, and medallion architecture.
- Design scalable data platforms using Microsoft Fabric components, including OneLake, Lakehouse, Data Warehouse, Data Factory, Data Engineering, Real-Time Intelligence, and Power BI.
- Architect ETL/ELT pipelines using Data Factory, Spark Notebooks, SQL, Python, PySpark, and Apache Spark to integrate data from cloud and on-premises systems.
- Establish data modelling standards, dimensional models, Lakehouse architectures, semantic models, and reusable patterns for reporting and analytics.
- Define and implement DevOps, CI/CD, and automation strategies using Azure DevOps, GitHub Actions, Git integration, deployment pipelines, infrastructure-as-code, and automated testing.
- Design and enforce security, governance, and compliance frameworks using Microsoft Entra ID, RBAC, workspace roles, OneLake access policies, sensitivity labels, row-level security, and Microsoft Purview.
- Optimise Spark workloads, SQL Warehouse performance, and OneLake storage through partitioning, indexing, caching, monitoring, and resource management.
- Lead cloud migration and modernisation initiatives, and oversee production deployments, monitoring, incident resolution, disaster recovery, backups, and business continuity.
- Collaborate with stakeholders and cross-functional teams, communicate architecture decisions and roadmaps, and mentor data engineers and developers.
View Full Description & ApplyYou'll be redirected to the employer's site