Principal/Lead Data Engineer

View full description

Requirements:

• Strong experience as a Senior / Principal Cloud Data Engineer, with a solid track record of migrating large volumes of of data through the use of cloud data services and modern tooling
• Experience working on projects within large enterprise organisations either as an internal resource or as a 3rd party consultant
• Experience in performing a technical leadership role on projects and contributing to technical decision making during in-flight projects
• A track record of being involved in a wide range of projects with various tools and technologies, and solving a broad range of problems using your technical skills
• Demonstrable experience of utilising strong communication and stakeholder management skills when engaging with customers
• Significant experience of coding in Python and Scala or Java
• Experience with big data processing tools such as Hadoop or Spark
• Cloud experience; GCP specifically in this case, including services such as Cloud Run, Cloud Functions, BigQuery, GCS, Secret Manager, Vertex AI etc.
• Experience with Terraform
• Prior experience in a customer-facing consultancy role would be highly desirable
• Experience in working with agile software engineering teams

Responsibilities:

• Lead client engagements and team lead on client-facing delivery projects
• Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability
• Identify, scope, and participate in the design and delivery of cloud data platform solutions
• Deliver highly scalable big data architecture solutions using Google Cloud Technology
• Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and other data technologies
• Design and execute a platform modernization approach for customers' data environments
• Document and share technical best practices/insights with engineering colleagues and the Data Engineering community
• Mentor and develop engineers within the Qodea Data Team and within our customers' engineering teams
• Act as the point of escalation with client-facing problems that need solving