Lead Data Engineer

View full description

Requirements:

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Proficiency in data modeling and using AWS services.
• Proven experience as a Data Engineer or similar role.
• Strong knowledge of AWS services related to data engineering.
• Experience designing and building data pipelines.
• Understanding of data lake and warehousing best practices.
• Proficiency in programming languages for data manipulation (e.g., Python, SQL).
• Experience with relational databases like PostgreSQL.
• Understanding of database systems and performance optimization.
• Experience implementing data quality checks.
• Familiarity with Cloudformation and CI/CD for deployment.
• Experience with data quality validation tools.
• Ability to work independently and collaboratively.

Responsibilities:

• Designing and implementing scalable, robust, and maintainable data pipelines using AWS services.
• Implementing data quality checks and validation processes.
• Designing data models and architectures for data processing workflows.
• Utilizing validation tools to automate processes.
• Collaborating with cross-functional teams to meet data requirements.
• Monitoring and optimizing data pipeline performance.
• Debugging and resolving data-related issues.
• Documenting data pipeline architectures and processes.
• Staying updated with new technologies in data engineering.