Staff Software Engineer, Distributed Data Systems

New
O
OnehouseData Infrastructure
India-RemoteFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Required Skills
JavaKubernetesC++Data engineeringDistributed Systems

Requirements

  • Strong, object-oriented design and coding skills (Java and/or C/C++).
  • Experience developing on UNIX or Linux platforms.
  • In-depth experience with the inner workings of distributed, multi-tiered systems.
  • Deep knowledge of algorithms and relational database internals.
  • Experience running production services at scale.
  • Proven ability to think abstractly and articulate technical challenges and solutions.
  • Ability to prioritize feature development and technical debt with urgency.
  • Ability to prototype optimization solutions and analyze complex data.
  • Robust and clear communication skills.
  • Experience with database systems, query engines, or Spark codebases (nice to have).
  • Background in optimization mathematics or relevant publications (nice to have).

Responsibilities

  • Design new concurrency control and transactional capabilities to maximize throughput for competing writers.
  • Implement new indexing schemes optimized for incremental data processing and analytical query performance.
  • Develop systems to scale and streamline metadata and data access across different query and compute engines.
  • Solve optimization problems to improve the performance and efficiency of distributed data processing algorithms on Kubernetes.
  • Analyze system data to identify inefficiencies, build prototypes, and validate solutions.
  • Collaborate with engineering teams to deploy and safely roll out optimized solutions in production.
  • Serve as an SME to deepen team expertise in database internals, query engines, storage, and stream processing.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now