Senior Data Engineer
New
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- AWSPythonSQLApache AirflowAzureSparkData modelingRedshiftDatabricks
Requirements
- 4+ years of hands-on experience in data engineering
- Experience preferably in consulting or client-facing environments
- Strong proficiency in SQL
- Strong proficiency in Python for data processing and pipeline development
- Solid experience with Databricks (Spark, Delta Lake, Unity Catalog, job orchestration)
- Proven expertise in Apache Airflow for workflow orchestration (DAG design, scheduling, monitoring)
- Experience working with cloud platforms such as Azure (ADF, ADLS, Synapse)
- Experience working with cloud platforms such as AWS (Glue, S3, Redshift)
- Strong understanding of data modeling concepts (dimensional and lakehouse architectures)
- Ability to work independently in remote environments with minimal supervision
- Excellent communication skills
- Strong analytical thinking and problem-solving skills
Responsibilities
- Design, build, and optimize scalable data pipelines and platforms
- Ensure reliable data delivery and high-quality analytics across enterprise environments
- Design, develop, and maintain robust ETL/ELT pipelines using Databricks and Apache Airflow
- Build and manage data models across lakehouse architectures (Bronze, Silver, Gold layers)
- Develop efficient and scalable data transformation logic using SQL and Python
- Deploy and manage data workloads on cloud platforms such as Azure and AWS
- Collaborate with data architects, analysts, and stakeholders to translate business requirements into technical solutions
- Monitor pipeline performance, troubleshoot issues, and continuously improve data reliability and quality
- Document technical designs, data flows, and operational processes
- Operate with a high degree of independence, proactively identifying risks, blockers, and optimization opportunities
View Full Description & ApplyYou'll be redirected to the employer's site