iiDENTIFII - Data Engineering Technical Lead

View full description

Requirements:

• 2+ years of proven leadership in mentoring teams and driving performance.
• 5+ years in data engineering, building cloud-native data platforms.
• Experience with designing scalable pipelines using Apache Spark and Databricks.
• Proficiency in orchestrating data workflows with tools like Airflow and Azure Data Factory.
• Experience with streaming platforms like Kafka and Azure Event Hubs.
• Strong understanding of data security, governance, and architecture.
• Proficiency in Linux and Python for data automation.
• Experience implementing DevOps, DataOps, and CI/CD pipelines.
• Database administration skills, particularly in Microsoft or Azure SQL.
• 3-5 years of experience with Microsoft Azure.
• 2+ years with BI and visualization tools like Power BI.

Responsibilities:

• Drive the Data Engineering Team, guiding projects while being hands-on.
• Build a modern Data Platform with the latest architecture and best practices.
• Mentor and inspire team members to grow into experts.
• Code and solve problems as the leading engineer.
• Ensure delivery of valuable data products and reports.
• Collaborate with stakeholders to integrate the data platform with other products.