ApplyStaff Data Engineer (m/f/d)
Posted about 1 month agoViewed
View full description
Requirements:
- Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy.
- Extensive experience in data engineering, including ETL, data warehousing, and data pipelines.
- Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc.
- Experience with real-time data processing frameworks like Apache Kafka/MSK.
- Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena.
- Ability to design efficient and scalable data models.
- Strong analytical skills to identify and solve complex data problems.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
Responsibilities:
- Manage and grow a remote team of data engineers based in Europe.
- Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines.
- Lead and own data engineering projects, including data ingestion, transformation, and storage.
- Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.
- Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.
- Create efficient data models and optimize database queries for optimal performance.
- Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions.
- Mentor junior data engineers and share your expertise. Establish and promote best practices.
Apply