Staff Software Engineer, Applied AI
New
Based in the United StatesFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonFull Stack DevelopmentMachine LearningTypeScriptFastAPIReactPrompt EngineeringLLMLangChain
Requirements
- 5+ years of professional software engineering experience in production environments.
- Strong background in full-stack development, particularly with Python-based web applications (FastAPI or similar frameworks).
- Proven experience building and shipping agentic LLM workflows to production using orchestration tools (e.g., LangChain, LangGraph, or similar).
- Hands-on experience designing evaluation systems for LLM applications, including test datasets, eval harnesses, and regression tracking.
- Familiarity with prompt engineering and iterative LLM optimization practices.
- Experience working in fast-paced startup or 0-to-1 environments with high ownership and autonomy.
- Strong communication skills with the ability to drive alignment across technical and non-technical stakeholders.
Responsibilities
- Design and build agentic LLM pipelines that power AI-driven product features across the platform, ensuring scalability and production reliability.
- Develop full-stack applications using Python (FastAPI) and TypeScript/React to support AI-enabled workflows and user-facing tools.
- Build and maintain robust evaluation frameworks, including curated datasets, automated testing, regression detection, and performance benchmarking for LLM systems.
- Iterate on prompt engineering strategies and model usage, balancing accuracy, latency, and cost considerations.
- Enhance production observability by implementing feedback loops, monitoring accuracy signals, and improving system reliability over time.
- Partner with cross-functional product and engineering teams to identify opportunities for AI integration and guide implementation strategy.
- Provide technical direction on when and how to apply AI/LLM solutions effectively to maximize impact and avoid unnecessary complexity.
View Full Description & ApplyYou'll be redirected to the employer's site
