Senior AI Product Engineer, Backend

View full description

Requirements:

• 5+ years of experience working with high-performance backend systems.
• Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
• Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
• Previous work building and operating highly complex SaaS platforms/systems.
• Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Responsibilities:

• Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
• Build high-volume and highly available analytics systems.
• Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
• Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
• Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
• Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
• Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
• Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
• Contribute to the build our own in-house AI Agents.