remoote.app

Work from anywhere. Start here.

Remoote.app

Work from anywhere. Start here.

Free resume builderCompaniesLog in
Home
Jobs
Full-stack Software Engineer III/Senior, AI Gateway

Full-stack Software Engineer III/Senior, AI Gateway

New
N
ngrokAI infrastructure
This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco.Full-TimeSenior
SalarySenior Software Engineer — Tier 1 (SF, LA, Seattle, NYC): $202,500 – $247,500; Tier 2 (rest of US): $186,300 – $227,700. Software Engineer III — Tier 1 (SF, LA, Seattle, NYC): $180,000 – $220,000; Tier 2 (rest of US): $165,600 – $202,400. We provide an attractive mix of salary and equity.
Apply NowOpens the employer's application page
More jobs in this role

Job Details

Required Skills
HTMLCSSJavaTypeScriptC++GoReactRust

Requirements

  • Be comfortable with a statically typed, compiled language such as Go, Rust, C++, or Java; Go is a bonus.
  • Have frontend engineering experience, including TypeScript, React, HTML, and CSS.
  • Have experience working with AI/LLMs and their edge cases.
  • Care about developer experience and thoughtful abstractions.
  • Be interested in defining system behavior, not just plumbing.
  • Consider retries, limits, and costs when designing systems.
  • Extra credit for experience with AI platforms or inference infrastructure.
  • Extra credit for experience with API gateways that have product-level opinions.
  • Extra credit for experience with usage limits, quotas, or billing-adjacent systems.
  • Extra credit for experience with customer-facing observability tools.

Responsibilities

  • Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
  • Design and implement AI Gateway Traffic Policy Objects, including rate limits, usage caps, and access rules.
  • Build and maintain systems that measure AI requests, tokens, and related metadata.
  • Expose signals showing what AI traffic was allowed or blocked, which policies applied, and how usage accumulated.
  • Work with product and design to build AI-specific gateway primitives that hide provider and infrastructure complexity.
  • Collaborate with Gateway, Customer Data, and Platform teams to align usage data, policy enforcement, and billing signals.
View Full Description & ApplyYou'll be redirected to the employer's site
Senior Software Engineer — Tier 1 (SF, LA, Seattle, NYC): $202,500 – $247,500; Tier 2 (rest of US): $186,300 – $227,700. Software Engineer III — Tier 1 (SF, LA, Seattle, NYC): $180,000 – $220,000; Tier 2 (rest of US): $165,600 – $202,400. We provide an attractive mix of salary and equity.
Apply Now