Member of Technical Staff - Model Serving / API Backend Engineer
New
B
Black Forest LabsGenerative AI
Freiburg (Germany), San Francisco (USA)Full-TimeSenior
Salary180,000 - 300,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- DockerPythonKubernetesFastAPIPostgresRedis
Requirements
- Experience scaling APIs or ML systems under load
- Experience building and operating ML inference services in production
- Strong judgment around performance, reliability, and cost tradeoffs
- Proficiency in Python and FastAPI with async systems
- Designing scalable API architectures with async processing
- Experience with GPU infrastructure, CUDA, and inference optimization
- Experience with Docker and Kubernetes
- Experience with Redis, Postgres, and distributed task queues
- Experience with cloud platforms (AWS, GCP, or Azure)
- Comfortable implementing monitoring and observability for production ML systems
- Debugging performance bottlenecks across model, infrastructure, and network layers
Responsibilities
- Turn research checkpoints into production-ready inference services
- Design and maintain high-performance APIs serving millions of requests
- Optimize inference latency and throughput across GPU infrastructure
- Build scalable serving architectures that handle unpredictable traffic
- Improve reliability, monitoring, and observability across model-serving systems
- Prototype and ship demos that showcase new capabilities in days, not weeks
- Collaborate closely with researchers to move from idea to live endpoint rapidly
View Full Description & ApplyYou'll be redirected to the employer's site
