Staff Data Engineer
New
C
CloudbedsHospitality Software
Canada; EuropeFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- DockerPythonSQLApache HadoopKubernetesApache KafkaSparkScala
Requirements
- Deep knowledge of data architecture, ETL/ELT pipelines, and distributed systems.
- Ability to design scalable, high-performance solutions.
- Strong skills in writing clean, maintainable code in Python, SQL, or Scala.
- Proficiency with version control, testing, and CI/CD for data.
- Expertise in distributed computing and containerization (Docker, Kubernetes).
- Expertise in streaming technologies (Kafka, Confluent).
- Ability to mentor junior team members.
- Strong sense of responsibility for data accuracy, lineage, and security.
Responsibilities
- Design and implement large-scale distributed data processing systems using technologies like Apache Hadoop, Spark, and Flink.
- Build robust data pipelines and infrastructure that transform complex data into actionable insights.
- Ensure scalability and fault-tolerance across the platform.
- Architect data lakes, warehouses, and real-time streaming platforms.
- Implement security measures and optimize system performance.
- Evaluate new technologies to continuously improve the data ecosystem.
- Collaborate cross-functionally with analysts, data scientists, and engineers.
- Mentor junior team members and raise the team’s technical bar.
View Full Description & ApplyYou'll be redirected to the employer's site