Staff Data Engineer
New
GermanyFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSDockerPythonSQLHadoopKafkaKubernetesAirflowSpark
Requirements
- Strong experience designing and managing distributed data systems and large-scale data architectures.
- Advanced knowledge of technologies such as Apache Spark, Hadoop, Flink, Kafka, and cloud-based data platforms.
- Proven expertise in building scalable ETL/ELT pipelines and streaming data solutions.
- Strong programming skills in Python and SQL; additional experience with Java or Scala is considered a plus.
- Experience with containerization and orchestration technologies such as Docker and Kubernetes.
- Solid understanding of data governance, security, reliability, and infrastructure best practices.
- Familiarity with cloud ecosystems and tools such as AWS, Confluent, Airflow, dbt, GitHub Actions, and CI/CD workflows.
- Excellent analytical and problem-solving skills with the ability to independently manage projects from concept to production.
- Strong communication and collaboration abilities within remote and globally distributed teams.
- Experience mentoring team members and contributing to technical leadership initiatives is highly valued.
- Hospitality industry knowledge or experience working with commercial platform ecosystems is considered an advantage.
Responsibilities
- Design, build, and maintain scalable distributed data processing systems using modern big data technologies.
- Develop robust ETL/ELT pipelines and real-time streaming architectures to support large-scale analytics and operational needs.
- Architect and optimize data lakes, data warehouses, and streaming platforms for performance, scalability, and reliability.
- Implement secure and fault-tolerant data infrastructure across cloud-based environments.
- Improve data quality, governance, lineage, and platform reliability to ensure trusted and accessible data across teams.
- Collaborate cross-functionally with engineers, analysts, and data scientists to deliver impactful data solutions aligned with business objectives.
- Drive infrastructure modernization initiatives, evaluate emerging technologies, and contribute to continuous platform improvement.
- Mentor junior engineers, promote best practices, and contribute to a culture of collaboration and technical excellence.
- Optimize system and pipeline performance through efficient partitioning, indexing, caching, and query optimization strategies.
- Support CI/CD workflows, automation, and deployment processes to ensure efficient and reliable delivery cycles.
View Full Description & ApplyYou'll be redirected to the employer's site
