Data Engineering Lead
New
J
JobgetherData engineering
Based in the United StatesFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLPySpark
Requirements
- Strong experience in AWS data engineering, particularly Amazon S3, AWS Glue, and Amazon EMR.
- Proficiency in Python, PySpark, SQL, and ETL/ELT development.
- Expertise in designing, developing, and optimizing large-scale data pipelines.
- Solid experience with enterprise data integration and complex data engineering environments.
- Proven ability to provide technical leadership and establish engineering standards.
- Experience conducting code and design reviews.
- Experience mentoring and guiding data engineering teams.
- Experience with Amazon Redshift, Athena, and DynamoDB is preferred.
- Knowledge of Apache Iceberg and modern data lake or lakehouse architectures is preferred.
- Familiarity with domain-oriented data products and authoritative data sources is preferred.
- Exposure to large-scale enterprise data platform modernization initiatives is preferred.
Responsibilities
- Lead the architecture, design, and development of scalable data pipelines using AWS Glue, EMR, S3, Python, and PySpark.
- Drive enterprise data integration initiatives and implement ETL/ELT workflows.
- Lead the development of reliable, scalable, and reusable data products.
- Define and maintain engineering standards, best practices, and development guidelines.
- Conduct technical design reviews and code reviews to ensure solution quality and consistency.
- Optimize data pipelines for performance, data quality, processing efficiency, and scalability.
- Mentor and guide Data Engineers, supporting their technical development and delivery.
- Collaborate with architecture, technology, and business teams to align solutions with enterprise objectives.
View Full Description & ApplyYou'll be redirected to the employer's site
