Senior Data Engineer

New
S
SRM TechnologiesCloud data engineering
Source API remote eligibility restrictions: IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
8+ years of overall Data Engineering experience
Required Skills
AWSPythonSQLSnowflakeData modelingdbtPySpark

Requirements

  • 8+ years of overall Data Engineering experience.
  • Strong hands-on experience building enterprise-scale cloud data platforms and pipelines.
  • Advanced, production-quality Python data engineering skills.
  • PySpark or Apache Spark experience, including distributed processing, optimization, and troubleshooting.
  • Snowflake development, data modeling, optimization, and performance-tuning experience.
  • Experience building dbt models and implementing tests, documentation, and deployment practices.
  • Apache Iceberg experience with lakehouse or table design, partitioning, schema evolution, and optimization.
  • Hands-on AWS cloud data platform experience and advanced SQL skills.
  • Experience with ETL/ELT, batch and incremental pipelines, data quality, and orchestration.
  • Bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related discipline preferred.
  • AWS and/or Snowflake certification is an added advantage.

Responsibilities

  • Design, develop, test, and maintain scalable ETL/ELT pipelines and production-quality data-processing solutions using Python and PySpark.
  • Build reusable components for data ingestion, transformation, validation, and publishing.
  • Develop Snowflake data solutions, SQL transformations, data models, and reusable data structures; optimize performance and cost.
  • Build modular dbt models, tests, and documentation, and support automated deployment and CI/CD practices.
  • Design Apache Iceberg lakehouse solutions, including table structures, partitioning, schema evolution, and maintenance strategies.
  • Build cloud-native data workloads on AWS using services such as S3, Glue, EMR, and Lambda; implement secure access patterns using IAM.
  • Diagnose and optimize Spark/PySpark jobs, SQL queries, Snowflake workloads, and data pipelines.
  • Implement data-quality checks, logging, monitoring, exception handling, and reconciliation mechanisms.
  • Drive complex data-engineering requirements from design through production, troubleshoot issues, and contribute to architecture decisions.
  • Mentor other data engineers and collaborate with architects, product owners, analysts, data scientists, QA, DevOps, and application teams.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now