Platform Engineer - Data (SDE-3 / Staff)
New
W
Weekday AIData Platform
IndiaFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonJavaKubernetesData engineeringGoScalaDistributed Systems
Requirements
- 7+ years of software or platform engineering experience, with SDE-3 / Staff-level ownership.
- Proven experience owning a shared data platform in production.
- Expertise in distributed-systems design.
- Production-grade software development using Python, Java, Go, or Scala.
- Experience with batch processing, streaming, data ingestion/CDC, storage and query systems, and platform operations.
- Ability to improve reliability, scalability, performance, and developer self-service in large-scale environments.
- Strong technical leadership and ability to establish architectural standards.
- Experience with open-source technologies like Apache Iceberg, Hudi, Delta Lake, Kafka, Flink, Spark, Trino, or Kubernetes.
Responsibilities
- Build and evolve open-lakehouse foundations including table lifecycle management, partitioning, compaction, and schema evolution.
- Design and operate batch and streaming ingestion systems including CDC, data contracts, and failure handling.
- Develop platform services, APIs, and self-service capabilities for engineering and product teams.
- Build and manage orchestration and workload execution systems across Kubernetes and workflow technologies.
- Establish robust metadata, lineage, governance, data quality, and observability capabilities.
- Own production reliability, incident response, performance, cost optimization, and capacity planning.
View Full Description & ApplyYou'll be redirected to the employer's site
