Engineering Manager - Data Engineer
New
G
GroundTruthAdvertising Technology
IndiaFull-TimeManager
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in technology, specifically focused on data engineering, data warehousing, or big data architecture; 2+ years of experience of leading a data engineering team
- Required Skills
- PythonSQLApache AirflowGitData engineeringPySpark
Requirements
- Bachelor’s degree in Computer Engineering, Data Science, or equivalent.
- 8+ years of experience in data engineering, data warehousing, or big data architecture.
- 2+ years of experience leading a data engineering team.
- Expertise in Python and PySpark including handling data skew and memory management.
- Advanced AWS expertise managing Amazon EMR.
- Experience with big data infrastructure (S3, EMR, Glue, Athena, Lambda).
- Expert SQL skills for complex transformations and performance tuning.
- Advanced proficiency with Airflow and Git.
- Proven track record of leveraging AI tools like Cursor, Claude, or GitHub Copilot.
Responsibilities
- Oversee the design and deployment of large-scale distributed data processing jobs using PySpark on Amazon EMR clusters and serverless AWS Glue ETL jobs.
- Coach and mentor engineers on technical skills, data modeling best practices, and career progression.
- Partner with stakeholders and engineering leadership to evaluate, plan, and deliver data-first projects.
- Write production-ready Python and PySpark code, perform code reviews, and optimize Spark configurations.
- Apply Agile methodologies such as Scrum to drive iterative development and ensure continuous delivery.
- Support engineers through regular 1:1s, feedback, quarterly reviews, and performance management.
View Full Description & ApplyYou'll be redirected to the employer's site
