Senior Software Engineer – Foundational Data Systems for AI - India, remote

Depth in distributed systems: consensus, partitioning, replication, fault tolerance Experience with columnar formats such as Parquet or ORC and low-level encoding strategies Understanding of metadata-driven architectures and adaptive query planning Production experience with Spark, Flink, or custom distributed engines on cloud object storage Proficiency in Java, Rust, Go, or C++ with an emphasis on clarity and quality Curiosity about theory of the mathematics of compression, entropy, and learning efficiency A builder’s mindset: pragmatic, rigorous, and grounded in long-term systems thinking

Architect the transactional and metadata substrate Build systems that reorganize data autonomously Optimize bit-level organization Develop distributed compute systems Implement new algorithms in compression, representation, and optimization Design for minimal time between question and insight