Lead Data Engineer

Posted 10 days agoViewed

💎 Seniority level: Lead

📍 Location: Europe

🔍 Industry: Supply Chain Risk Analytics

🪄 Skills: AWSPostgreSQLPythonSQLETLApache KafkaNosqlSparkData modeling

Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy.
Extensive experience in data engineering, including ETL, data warehousing, and data pipelines.
Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc.
Experience with real-time data processing frameworks like Apache Kafka/MSK.
Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena.
Ability to design efficient and scalable data models.
Strong analytical skills to identify and solve complex data problems.
Excellent communication and collaboration skills to work effectively with cross-functional teams.

Manage and grow a remote team of data engineers based in Europe.
Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines.
Lead and own data engineering projects, including data ingestion, transformation, and storage.
Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.
Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.
Create efficient data models and optimize database queries for optimal performance.
Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions.
Mentor junior data engineers and share your expertise. Establish and promote best practices.

Posted about 2 months ago

📍 Romania, UK, Netherlands, Belgium

🧭 Full-Time

🔍 Digital consultancy, Cloud services

🏢 Company: Qodea

🔧 Requirements

Strong experience as a Senior / Principal Cloud Data Engineer, with a solid track record of migrating large volumes of data.
Experience working on projects within large enterprise organisations.
Experience in performing a technical leadership role on projects.
A track record of being involved in a wide range of projects with various tools and technologies.
Strong communication and stakeholder management skills.
Significant experience in coding in Python and Scala or Java.
Experience with big data processing tools such as Hadoop or Spark.
Cloud experience, specifically with GCP and its services.
Experience with Terraform and working with agile software engineering teams.
Prior experience in a customer-facing consultancy role would be highly desirable.

💡 Responsibilities

Lead client engagements and team lead on client-facing delivery projects.
Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability.
Identify, scope, and participate in the design and delivery of cloud data platform solutions.
Deliver highly scalable big data architecture solutions using Google Cloud Technology.
Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and other data technologies.
Design and execute a platform modernization approach for customers' data environments.
Document and share technical best practices/insights with engineering colleagues and the Data Engineering community.
Mentor and develop engineers within the Qodea Data Team and within our customers' engineering teams.
Act as the point of escalation with client-facing problems that need solving.

LeadershipPythonSQLAgileGCPHadoopJavaData engineeringSparkTerraform

Posted about 2 months ago