Senior Software Engineer, ML Infrastructure
New
S
SambaNova SystemsGenerative AI
Remote - USFull-TimeSenior
Salary200,000 - 275,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonAlgorithmsData StructuresLLMDistributed Systems
Requirements
- Bachelor's degree in Computer Science, Electrical Engineering, or related field
- 5+ years of industry experience building and operating large-scale distributed systems
- Strong software engineering fundamentals: algorithms, data structures, concurrency, and systems design
- Experience designing and maintaining production services with strict latency, throughput, and availability requirements
- Working knowledge of modern LLM inference techniques
- Familiarity with open-source serving stacks such as vLLM, TensorRT-LLM, or SGLang
- Proficiency in Python
- Experience collaborating across teams to deliver complex, system-level engineering solutions
Responsibilities
- Design and productionize advanced inference techniques on RDU to optimize for performance and cost.
- Own SambaNova's integration with vLLM and adjacent serving frameworks.
- Own the public inference API surface exposed through SambaStack and SambaCloud.
- Build and maintain the accuracy verification and regression infrastructure.
- Partner with ML, compiler, runtime, and product teams to take inference features from prototype to production.
- Contribute to technical design discussions, code reviews, and architectural decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
