Senior Data Engineer
New
S
SRM TechnologiesCloud data engineering
Source API remote eligibility restrictions: IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of overall Data Engineering experience
- Required Skills
- AWSPythonSQLSnowflakeData modelingdbtPySpark
Requirements
- 8+ years of overall Data Engineering experience.
- Strong hands-on experience building enterprise-scale cloud data platforms and pipelines.
- Advanced, production-quality Python data engineering skills.
- PySpark or Apache Spark experience, including distributed processing, optimization, and troubleshooting.
- Snowflake development, data modeling, optimization, and performance-tuning experience.
- Experience building dbt models and implementing tests, documentation, and deployment practices.
- Apache Iceberg experience with lakehouse or table design, partitioning, schema evolution, and optimization.
- Hands-on AWS cloud data platform experience and advanced SQL skills.
- Experience with ETL/ELT, batch and incremental pipelines, data quality, and orchestration.
- Bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related discipline preferred.
- AWS and/or Snowflake certification is an added advantage.
Responsibilities
- Design, develop, test, and maintain scalable ETL/ELT pipelines and production-quality data-processing solutions using Python and PySpark.
- Build reusable components for data ingestion, transformation, validation, and publishing.
- Develop Snowflake data solutions, SQL transformations, data models, and reusable data structures; optimize performance and cost.
- Build modular dbt models, tests, and documentation, and support automated deployment and CI/CD practices.
- Design Apache Iceberg lakehouse solutions, including table structures, partitioning, schema evolution, and maintenance strategies.
- Build cloud-native data workloads on AWS using services such as S3, Glue, EMR, and Lambda; implement secure access patterns using IAM.
- Diagnose and optimize Spark/PySpark jobs, SQL queries, Snowflake workloads, and data pipelines.
- Implement data-quality checks, logging, monitoring, exception handling, and reconciliation mechanisms.
- Drive complex data-engineering requirements from design through production, troubleshoot issues, and contribute to architecture decisions.
- Mentor other data engineers and collaborate with architects, product owners, analysts, data scientists, QA, DevOps, and application teams.
View Full Description & ApplyYou'll be redirected to the employer's site