Senior Data Engineer (Flink)
New
S
SSC HR SolutionsData Engineering
Cairo, Cairo Governorate, EgyptFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- DockerPythonSQLJavaKafkaKubernetesAirflowScala
Requirements
- Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
- Experience with high-volume Kafka streaming and real-time data processing.
- Strong knowledge of event time processing, checkpointing, savepoints, and state management.
- Experience with data modelling for analytics and streaming into a lakehouse.
- Experience monitoring pipeline health and handling job recovery and failures.
- Proficiency in Java, Scala, and Python.
- Experience with SQL.
- Experience with Docker and Kubernetes.
- Familiarity with Apache Iceberg or other open table formats.
- Experience with Airflow.
- Experience with on-premises or self-managed clusters.
Responsibilities
- Build and run real-time streaming pipelines, keeping latency low and jobs recoverable at high volume.
- Utilize Apache Flink across DataStream API and Flink SQL.
- Manage event time processing, checkpointing, savepoints, and state management in production.
- Implement high-volume Kafka streaming.
- Develop data modelling for analytics and streaming into a lakehouse.
- Monitor pipeline health and handle recovery when jobs fail.
View Full Description & ApplyYou'll be redirected to the employer's site
