Senior/Staff Software Engineer (Back-End), Inference
New
C
CohereEnterprise AI
Location: Canada; Secondary Locations: San Francisco, United States, New York, Ottawa, Toronto, Montreal; Workplace: RemoteFull-TimeStaff
Salary$205K - $315K; $205K – $315K • Offers Equity • Multiple Ranges; USA - California, New York and Washington: Base Salary $225K – $315K • Offers Equity; USA - All Other States: Base Salary $205K – $275K • Offers Equity; Canada: Base Salary CA$290K – CA$400K • Offers Equity
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonJavaC++GoRustDistributed Systems
Requirements
- Bring strong backend engineering skills and fundamentals in distributed systems, databases, networking, operating systems, and security.
- Have strong programming fundamentals and production-systems experience in Go, Python, Java, C++, Rust, or a similar language.
- Write clean, maintainable, well-tested code and make thoughtful tradeoffs among simplicity, performance, and correctness.
- Have designed and operated production systems where correctness, availability, security, and performance mattered at significant scale.
- Be able to define architecture for ambiguous, high-impact technical problems and drive solutions through to reliable production systems.
- Understand systems-design concepts including concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation.
- Understand security boundaries, authentication, authorization, identity, cryptography, secrets, and tenant isolation.
- Be comfortable working across backend services, APIs, databases, distributed systems, and cloud infrastructure.
- Be comfortable debugging complex problems across unfamiliar codebases and service boundaries.
- Understand production engineering practices including instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rollouts.
- Have a track record of taking technically difficult projects from an unclear starting point to systems that engineers and customers depend on.
Responsibilities
- Evolve and scale Model Vault backend systems, including authentication and authorization, deployment management, billing, metering, and customer lifecycle.
- Lead architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundations.
- Build reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms.
- Design APIs and distributed systems with guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability.
- Build security and privacy into platform architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries.
- Solve problems spanning backend systems, cloud infrastructure, security, and AI inference.
- Drive projects from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloads.
View Full Description & ApplyYou'll be redirected to the employer's site
