Staff Software Engineer – Foundational Data Systems for AI - India, remote

Mastery of distributed systems (consensus, replication, consistency, performance) Proven track record of architecting and delivering large-scale data or compute systems Expertise with columnar formats and low-level data representation techniques Deep production experience with Spark, Flink, or next-generation compute frameworks Fluency in Java, Rust, Go, or C++ Demonstrated leadership (mentoring, influencing architecture, scaling technical excellence) Systems intuition rooted in theory (compression, entropy, information efficiency)

Define and evolve global metadata and transactional substrate Architect self-optimizing systems for data reorganization and compression Pioneer new approaches to data encoding and layout Lead development of distributed compute platforms Collaborate with research to translate advances into production systems Drive system-wide initiatives to minimize latency