Senior Data Engineer

View full description

Requirements:

• Bachelor's or Master's degree in computer science, engineering, or a related field.
• Minimum of 7 years of industry experience as a data engineer or in a similar role.
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience in designing and implementing data pipelines using tools like Apache Kafka, Apache Spark, or AWS Glue.
• Proficiency in SQL and database technologies like PostgreSQL, MySQL, or MongoDB.
• Knowledge of cloud platforms such as Azure.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration abilities.
• Ability to work effectively in cross-functional teams.
• Detail-oriented and proactive mindset.

Responsibilities:

• Design and develop scalable and reliable data pipelines, ensuring high availability and performance.
• Construct intricate data sets that align with functional and non-functional business requirements.
• Identify, plan, and implement internal process enhancements, such as automation of manual processes and data delivery optimization.
• Implement best practices for data storage, processing, and retrieval.
• Collaborate with stakeholders including executives, data scientists, and product managers to understand data requirements and implement data solutions.
• Optimize and tune data workflows to achieve optimal performance and efficiency.
• Maintain data security and compliance with data privacy regulations.
• Stay up-to-date with emerging technologies and industry trends in data engineering and analytics.
• Mentor and guide more junior data engineers in the team.