Engineering Manager, Provider Ecosystem
New
O
OpenRouterAI Infrastructure
Remote (US)Full-TimeManager
Salary$245K - $295K; $245K – $295K • Offers Equity
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of engineering management experience
- Required Skills
- GCPTypeScriptClickhousePostgresDistributed Systems
Requirements
- 4+ years of engineering management experience, including scaling teams in rapid-growth environments.
- Strong technical foundation in distributed systems, API design, and LLM inference.
- Understanding of inference serving, streaming, tool calling, prompt caching, and quantization.
- Proficiency in routing high-volume requests across heterogeneous endpoints.
- Hands-on coding ability and experience with AI-assisted development tools.
- Capability to lead technical negotiations with external model labs.
- Data-driven approach to quality using benchmarks, evals, and production telemetry.
- Proven track record of recruiting and retaining strong engineering talent.
- High agency and clear communication style, with a pragmatic approach to engineering processes.
Responsibilities
- Hire and grow strong engineers while setting team roadmap and advocating for team needs.
- Manage provider adapters, endpoint lifecycle, and routing logic.
- Serve as technical counterpart to top model providers for day-zero and stealth launches.
- Coordinate with GTM, BD, and legal teams to onboard providers from NDA to live.
- Lead expansion into image, video, audio, and embeddings, plus realtime and batch inference.
- Manage evaluation frameworks and inference quality to inform routing decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
