Senior Data Engineer
New
J
JobgetherData Engineering
IndiaContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- SQLMicrosoft Power BISparkCI/CDDatabricksPySpark
Requirements
- 5+ years of professional experience in Data Engineering, Analytics Engineering, or Data Platform Development.
- Strong hands-on expertise with Databricks, Apache Spark/PySpark, SQL, Microsoft Fabric, Delta Lake, and data warehousing.
- Proven experience designing and implementing data pipelines, ETL/ELT solutions, lakehouse architectures, and data integration frameworks.
- Strong knowledge of Databricks Workflows, Jobs, automation, and orchestration.
- Experience developing automated testing, data validation, QA, and reconciliation frameworks.
- Hands-on experience implementing CI/CD pipelines using Azure DevOps, GitHub, or comparable tools.
- Solid understanding of data quality, reconciliation, metadata management, data governance, and security practices.
- Experience with performance tuning and optimization of Spark-based workloads.
- Practical experience with Microsoft Fabric components, including Data Factory, Lakehouse, Warehouse, Semantic Models, and Power BI.
- Bachelor’s degree or equivalent educational qualification.
Responsibilities
- Design, develop, and maintain scalable data solutions using Databricks, Microsoft Fabric, Apache Spark, PySpark, SQL, and Delta Lake.
- Build and optimize enterprise-grade data ingestion, ETL/ELT, transformation, orchestration, and integration pipelines.
- Develop automation frameworks for data validation, testing, monitoring, deployment, and operational support.
- Own data engineering activities across the full lifecycle, including requirements gathering, solution design, development, testing, deployment, and ongoing support.
- Build automated QA, reconciliation, and validation frameworks for analytical and reporting solutions.
- Ensure enterprise datasets meet requirements for data quality, completeness, consistency, accuracy, and business-rule compliance.
- Develop and maintain lakehouses, warehouses, semantic models, and data marts within Microsoft Fabric.
- Implement and validate security and governance controls, including Row-Level Security (RLS).
- Support CI/CD, DevOps, DataOps, and Infrastructure-as-Code initiatives and deployment automation.
View Full Description & ApplyYou'll be redirected to the employer's site
