Senior Software Engineer - Dev Platform

New

JobgetherAI infrastructure

Work remotely from BrazilFull-TimeSenior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Have experience as a backend or platform software engineer building, deploying, and operating APIs and distributed services in production.
Be proficient in at least one backend programming language, such as Rust, Python, or TypeScript.
Write clean, maintainable, well-tested code.
Understand LLM APIs, including authentication, streaming responses, token accounting, rate limits, and provider failures.
Have experience with observability practices, CI/CD pipelines, and containerized applications.
Have working knowledge of Kubernetes and at least one major cloud provider.
Be able to design well-documented APIs and developer tools for internal customers, balancing technical considerations with usability and user feedback.
Take ownership of projects from conception through production and communicate clearly in writing and verbally.
Work effectively across engineering, security, and operations teams in a distributed environment.
Experience with API gateways, reverse proxies, or traffic management systems is a plus.
Experience building LLM-powered applications or infrastructure, including model routing, caching, evaluation, and cost-control mechanisms, is a plus.
Familiarity with OAuth, OpenID Connect (OIDC), and role-based access control (RBAC) is a plus.

Build and extend the AI Gateway by integrating models and providers, implementing routing policies, and developing budget controls, rate limits, and usage and cost reporting.
Design and maintain APIs, SDKs, and self-service tools for engineering teams.
Support migration of existing LLM workloads to the gateway while minimizing disruption to users and production systems.
Implement access controls, API key management, authentication mechanisms, and audit logging with security stakeholders.
Develop observability for latency, errors, token consumption, and costs across workloads.
Own features from technical design and implementation through deployment, monitoring, and ongoing improvements.
Collaborate with site reliability engineering teams to maintain availability, performance, resilience, and operational quality.
Provide documentation, troubleshooting support, and technical guidance to internal users, incorporating their feedback into platform improvements.
Contribute to code reviews, design discussions, technical documentation, and engineering standards.

View Full Description & ApplyYou'll be redirected to the employer's site