Software Engineer III/Senior, AI Gateway

Posted 3 months agoViewed
147200 - 225000 USD per year
United StatesFull-TimeSoftware Development
Company:ngrok Inc.
Location:United States
Languages:English
Seniority level:Senior, 3+ years
Experience:3+ years
Skills:
Backend DevelopmentSoftware DevelopmentCloud ComputingJavaC++GoRustCI/CDDevOpsMicroservicesProblem SolvingNetworking
Requirements:
3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++. Understand networking and distributed systems fundamentals (protocols, TLS/mTLS, proxies, load balancers, traffic shaping). Experience building AI gateways, reverse proxies, API gateways, or working with AI/ML service traffic. Motivated by building scalable, performant systems that developers love to use. Enjoy working at the intersection of infrastructure, security, and developer tooling/experience. Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.
Responsibilities:
Build and evolve gateway services for traffic routing and policy enforcement. Implement new traffic policy objects for granular customer control. Extend and optimize endpoint services for reliability and observability. Partner with product, platform, and security teams. Write clean, high-quality, well-tested code. Investigate and resolve production issues across distributed systems. Improve developer experience for configuring, securing, and scaling traffic. Contribute to the evolution of shared infrastructure, tools, and libraries.
About the Company
ngrok Inc.
View Company Profile
Similar Jobs:
Posted 9 months ago
WorldwideFull-TimeAlgorithmic Trading
Senior Gateway Engineer
Company:
Posted 3 months ago
United States, CanadaFull-TimeSoftware Development
Senior Manager, Engineering, AI Gateway
Company:Docker
Posted 20 days ago
Denver, Colorado, New York, New York, Dallas, Texas, Lisbon, PortugalFull-TimeHealthcare Technology
Software Engineer III
Company:Cleerly