Senior AI Engineer
New
P
Pair TeamHealthcare Technology
Remote (United States)Full-TimeSenior
Salary170,000 - 200,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of experience
- Required Skills
- PythonSoftware EngineeringLLM
Requirements
- 4+ years of experience building and shipping production software systems.
- Proven experience building multi-agent or agent-driven systems in production and real-world operational ownership.
- Hands-on experience with modern agent ecosystems, including frameworks (e.g., LangGraph, Mastra, Claude Agents SDK).
- Experience with observability/evals tooling (e.g., Langfuse, LangSmith, Braintrust).
- Experience with MCP implementations and leading AI SDKs (e.g., OpenAI, Anthropic).
- Strong systems and backend architecture fundamentals.
- Clear agentic evaluation mindset, including automated evals, simulation-based testing, regression frameworks, and metrics design.
- High velocity and ownership in AI-native development.
- Strong cross-functional collaboration and communication skills.
Responsibilities
- Contribute to the design and evolution of agentic systems that participate directly in care delivery, helping coordinate care, engage patients, and execute meaningful portions of care workflows.
- Define and build architectural patterns for agent reasoning, tool use, memory, and human-in-the-loop collaboration.
- Develop both reusable platform capabilities and product-facing implementations, balancing long-term architecture with rapid iteration.
- Own complex problem spaces end-to-end — from system design and implementation through observability, evaluation, and continuous improvement in production.
- Partner closely with product managers, operators, and domain experts to translate complex real-world processes into reliable agent behavior.
- Establish standards and best practices for agent evaluation, safety, and operational reliability as these systems evolve toward greater autonomy
View Full Description & ApplyYou'll be redirected to the employer's site
