Senior Data Engineer

New
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
4+ years
Required Skills
AWSPythonSQLApache AirflowAzureSparkData modelingRedshiftDatabricks

Requirements

  • 4+ years of hands-on experience in data engineering
  • Experience preferably in consulting or client-facing environments
  • Strong proficiency in SQL
  • Strong proficiency in Python for data processing and pipeline development
  • Solid experience with Databricks (Spark, Delta Lake, Unity Catalog, job orchestration)
  • Proven expertise in Apache Airflow for workflow orchestration (DAG design, scheduling, monitoring)
  • Experience working with cloud platforms such as Azure (ADF, ADLS, Synapse)
  • Experience working with cloud platforms such as AWS (Glue, S3, Redshift)
  • Strong understanding of data modeling concepts (dimensional and lakehouse architectures)
  • Ability to work independently in remote environments with minimal supervision
  • Excellent communication skills
  • Strong analytical thinking and problem-solving skills

Responsibilities

  • Design, build, and optimize scalable data pipelines and platforms
  • Ensure reliable data delivery and high-quality analytics across enterprise environments
  • Design, develop, and maintain robust ETL/ELT pipelines using Databricks and Apache Airflow
  • Build and manage data models across lakehouse architectures (Bronze, Silver, Gold layers)
  • Develop efficient and scalable data transformation logic using SQL and Python
  • Deploy and manage data workloads on cloud platforms such as Azure and AWS
  • Collaborate with data architects, analysts, and stakeholders to translate business requirements into technical solutions
  • Monitor pipeline performance, troubleshoot issues, and continuously improve data reliability and quality
  • Document technical designs, data flows, and operational processes
  • Operate with a high degree of independence, proactively identifying risks, blockers, and optimization opportunities
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now