Senior Data Engineer - (Remote - US)

View full description

Requirements:

• 8+ years of experience as a data engineer, with a strong background in data lake systems and cloud technologies.
• 4+ years of hands-on experience with AWS technologies, including S3, Redshift, EMR, Kafka, and Spark.
• Proficient in Python or Node.js for developing data pipelines and creating ETLs.
• Strong experience with data integration and frameworks like Informatica and Python/Scala.
• Expertise in creating and managing AWS services (EC2, S3, Lambda, etc.) in a production environment.
• Solid understanding of Agile methodologies and software development practices.
• Strong analytical and communication skills, with the ability to influence both IT and business teams.

Responsibilities:

• Design and develop scalable data pipelines that integrate enterprise systems and third-party data sources.
• Build and maintain data infrastructure to ensure speed, accuracy, and uptime.
• Collaborate with data science teams to build feature engineering pipelines and support machine learning initiatives.
• Work with AWS cloud technologies like S3, Redshift, and Spark to create a world-class data mesh environment.
• Ensure proper data governance and implement data quality checks and lineage at every stage of the pipeline.
• Develop and maintain ETL processes using AWS Glue, Lambda, and other AWS services.
• Integrate third-party data sources and APIs into the data ecosystem.