ApplyLead Data Engineer
Posted 3 months agoViewed
View full description
💎 Seniority level: Lead, 8 years
📍 Location: India
🔍 Industry: Digital engineering and modernization
🏢 Company: Encora👥 10001-10001💰 $200,000,000 Private over 5 years agoBig DataCloud ComputingSoftware
🗣️ Languages: English
⏳ Experience: 8 years
🪄 Skills: AWSLeadershipPythonSQLData AnalysisETLHadoopJenkinsAirflowData science
Requirements:
- 7-10 years of strong development experience performing ETL and/or data pipeline implementations.
- Expert in programming languages, preferably Python.
- Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift).
- Experience in batch technologies like Hadoop, Hive, Athena, Presto.
- Strong SQL skills, including query optimization, schema design, complex analytics.
- Expert in data modeling and metadata management like Glue Catalog etc.
- Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc.
- Experience in data quality tools like Deque or Great Expectations is Nice To Have.
Responsibilities:
- Collaborate and partner with Business Analyst teams located in US and EMEA regions.
- Interface across our Business Analyst and Data Science teams.
- Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud.
- Implement data lake solutions while addressing common data concerns, such as data quality, data governance.
- Set the standard for technical excellence as we move / build our data ecosystem into the cloud.
- Understand their common data problems and deliver scalable solutions.
Apply