Senior Data Engineer (Spark)
New
S
SSC HR SolutionsEngineering
Cairo, Cairo Governorate, EgyptFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- SparkData modeling
Requirements
- Strong hands-on experience with Apache Spark including performance tuning.
- Experience with data modelling for analytics and organising data in a lakehouse.
- Experience with automated scheduling, monitoring, and data quality checks.
- Experience with Apache Iceberg or other open table formats.
- Experience with Trino or similar query engines.
- Experience with on-premises or self-managed clusters.
Responsibilities
- Build and run large scale batch data pipelines, keeping jobs fast and affordable.
- Work with Apache Spark to build and manage large scale data processing jobs.
- Perform performance tuning to maintain efficient and reliable pipeline execution.
- Support data modelling for analytics and organise data in a lakehouse.
- Handle automated scheduling, monitoring, and data quality checks.
- Work with platform and product teams on end to end data flows.
View Full Description & ApplyYou'll be redirected to the employer's site
