Senior Product Manager, Inference Platform
New
C
CohereAI infrastructure
Location: Toronto; Secondary Locations: Canada, United States; Workplace: RemoteFull-TimeSenior
Salary$205K - $320K; $205K – $320K • Multiple Ranges; For candidates based in California, New York and Washington States: $230K – $320K; For candidates based elsewhere in the US: $205K – $290K; For candidates based in Canada: CA$295K – CA$360K
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years of product management experience
- Required Skills
- Product ManagementLangChain
Requirements
- Bring 10+ years of product management experience.
- Have meaningful experience owning a B2B infrastructure or platform product at business scope, rather than only a feature area.
- Have operated in a GM-like capacity, carrying a revenue line or P&L, setting pricing, and being accountable for margin and delivery.
- Have a background at a neocloud or hyperscaler and a working understanding of how inference capacity is priced, packaged, and sold.
- Show a track record of turning infrastructure capabilities into differentiated customer-facing products.
- Have experience taking a new product to market and building its commercial motion.
- Understand deployment models such as multi-tenant and dedicated infrastructure.
- Have owned the product lifecycle from problem definition through launch, iteration, and migration or deprecation.
- Define success metrics before building, instrument thoughtfully, and use data alongside qualitative feedback.
- Set direction and earn alignment across engineering, infrastructure, finance, legal, and GTM without formal authority.
- Communicate clear recommendations and trade-offs to executive audiences.
- Nice to have: experience owning a model serving or inference platform, including self-serve infrastructure and metered inference offerings.
- Nice to have: exposure to data residency, sovereignty, or regional compliance requirements for AI or cloud infrastructure products.
- Nice to have: familiarity with LangChain, LlamaIndex, vLLM, open standards, and the AI developer ecosystem.
Responsibilities
- Own the Inference as a Service P&L, revenue, rate card, and blended margin.
- Own the inference platform, including the customer console, dashboards, and value-add tooling.
- Manage the first-party and third-party model inventory, including catalog organization, pricing, quantization, replacement, and retirement.
- Set the roadmap and investment case across serving efficiency, the self-serve surface, and regional capacity.
- Build the commercial motion with GTM, including mid-market self-serve acquisition, enterprise sales, and capacity partnerships.
- Talk to customers and developers, track competitor pricing and catalogs, and assess model and hardware trends.
- Define and lead work on business metrics including revenue, margin, win rate, time to first token, and self-serve share.
- Partner with engineering, research, legal, finance, technical writing, and developer relations to ship the platform and resolve licensing, pricing, and capacity decisions.
- Present recommendations, supporting evidence, and trade-offs to the executive team.
View Full Description & ApplyYou'll be redirected to the employer's site
