AWS Data Engineer

View full description

Requirements:

• 8+ years experience as a Data Engineer.
• Experience with Scala, Spark and Apache Flink streaming.
• AWS Cloud Development.
• Experience with Kafka and/or other AWS streaming technologies.
• Proficiency in Python and Pyspark.
• Strong proficiency in SCALA.

Responsibilities:

• Designing, creating, and maintaining Scala-based data tasks to transform raw data into meaningful data models.
• Participating in all architectural development tasks related to the data pipeline.
• Writing code in accordance with the data model requirements.
• Collaborating with cross-functional teams.
• Mentoring team members in Scala development and management.
• Documenting Scala Development processes including Knowledge Documents, build and run books.
• Working with business analysts to understand requirements.
• Testing to ensure designs are in compliance with specifications.
• Debugging and resolving technical issues.
• Making recommendations to existing infrastructure.
• Continually engaging in professional development.
• Developing documentation to track.