Machine Learning Engineer (The AI Innovator)

View full description

Requirements:

• Experience with cloud data platforms such as AWS, GCP, or Azure.
• Proficiency in programming languages like Python, Java, or Scala.
• Ability to manage and optimize ETL processes with orchestration tools.
• Strong skills in writing complex SQL queries and working with relational and NoSQL databases.
• Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
• Certifications in cloud data engineering are a plus.
• 3+ years of experience in data engineering and cloud-based data systems.
• Experience with real-time data processing frameworks is advantageous.
• Familiarity with containerization and microservices architecture is a plus.

Responsibilities:

• Develop and maintain data pipelines for data ingestion, transformation, and integration using cloud technologies.
• Architect and maintain data lakes and data warehouses for performance and scalability.
• Collaborate with data scientists, analysts, and business stakeholders to align data solutions with business goals.
• Implement processes for data validation, error handling, and consistency checks.
• Build and automate ETL workflows to support efficient data integration and reporting.
• Use monitoring tools to track the performance of data systems and proactively resolve issues.
• Implement strategies for efficient resource allocation and cost-effective data processing.