Senior Data Engineer
A
AlimentivData engineering
Listing location: Bangalore; Workplace type: RemoteFull-TimeSenior
Salary2,094,639 - 3,603,725 INR per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5–8 years of experience designing and developing enterprise-scale data solutions
- Required Skills
- SQLMicrosoft Power BICI/CDDatabricksAzure DevOpsPySpark
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; a Master’s degree is preferred.
- 5–8 years of experience designing and developing enterprise-scale data solutions, including data warehouses, data lakes, or operational databases.
- Expert-level proficiency in Databricks, Azure Fabric, PySpark, SQL, and Azure DevOps.
- Experience with Azure Data Factory, ADLS Gen2, and Azure SQL Server.
- Strong experience with Microsoft Azure data management architectures, including data warehouses, data lakes, and data catalogues.
- Experience with data integration, governance, and metadata management.
- Power BI experience is required; Tableau or Looker experience is a plus.
- Working knowledge of CI/CD automation, Git version control, and infrastructure as code using ARM, Bicep, or Terraform.
- Understanding of GxP, GDPR/HIPAA, and applicable CFR/CTR/CTD regulations.
- Experience in life sciences or healthcare is a plus.
- Demonstrated ability to work with IT and business stakeholders and integrate analytics and data science output into business processes.
- Excellent written and verbal communication skills; able to work independently and as part of a team and meet deadlines.
Responsibilities
- Architect, design, and implement end-to-end data solutions using Azure Databricks, PySpark, Azure Data Factory, and Azure SQL.
- Build and maintain data pipelines from source systems through integration to consumption.
- Establish data modeling standards across bronze, silver, and gold data lake layers and develop conceptual, logical, or physical models.
- Optimize Spark and SQL workloads for performance, scalability, and cost efficiency.
- Automate data integration and workflows using Azure DevOps pipelines and Git-based CI/CD practices.
- Build API-based integrations using REST/JSON and real-time ingestion frameworks.
- Develop reusable pipeline templates and automated unit, regression, and integration testing frameworks.
- Prepare and curate datasets for BI, reporting, and advanced analytics, and partner with analytics teams on semantic models and KPIs.
- Lead technical design reviews, mentor junior engineers, and collaborate with business and IT stakeholders on data requirements and platform roadmaps.
View Full Description & ApplyYou'll be redirected to the employer's site
