Staff Software Engineer - Serverless

New

RunwareAI infrastructure

Workable locations: United Kingdom. United States. France. Germany. Spain. NetherlandsFull-TimeStaff

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Bring strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer, or in a similar role.
Have experience building backend services, distributed systems, developer platforms, or workload orchestration systems.
Understand asynchronous processing, queues, scheduling, retries, back pressure, and failure handling.
Be comfortable working across APIs, control planes, workers, databases, and observability systems.
Have strong engineering fundamentals in one or more backend languages; Go is preferred.
Apply sound judgment to trade-offs involving reliability, latency, scale, cost, and developer experience.
Demonstrate clear communication, strong ownership, and the ability to lead technical direction.
Nice to have: experience with serverless platforms, job execution systems, container platforms, or compute orchestration.
Nice to have: experience with GPU-backed workloads, AI/ML inference, model serving, batch processing, or high-performance computing.
Nice to have: familiarity with vLLM, TensorRT, Triton, Kubernetes, Nomad, or Knative.
Nice to have: experience improving workloads through batching, autoscaling, model warm-up, caching, request routing, or queue management.
Nice to have: experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting, or usage-based billing.

Build core serverless platform systems for workload execution, routing, scheduling, isolation, and scaling.
Create a simple SDK interface for developers to deploy models and run AI workloads without managing infrastructure.
Design and improve the serverless execution control plane, including APIs, workers, lifecycle management, retries, and failure handling.
Work with infrastructure and ML teams to improve workload startup time, GPU utilization, model warm-up, caching, and placement.
Build observability to monitor, debug, and operate serverless workloads at scale.
Lead technical design, mentor engineers, and help define engineering standards for a new product area.

View Full Description & ApplyYou'll be redirected to the employer's site