Staff AI Engineer
New
V
Veeam SoftwareData and AI
Remote, United StatesFull-TimeStaff
Salary265,600 - 680,200 USD per year total compensation
Apply NowOpens the employer's application page
Job Details
- Required Skills
- KubernetesPrompt EngineeringLLM
Requirements
- Proven experience integrating AI/ML services and APIs into production backend systems.
- Hands-on experience shipping LLM-powered capabilities end to end, such as RAG, summarization, or LLM-powered assistants.
- Experience designing and operating multi-step agentic workflows with real tool use.
- Working knowledge of Model Context Protocol (MCP).
- Experience with prompt engineering and evaluation including structured outputs, hallucination reduction, and LLM observability.
- Experience building multi-tenant systems with data boundary enforcement and tenant-aware access controls.
- Familiarity with authentication and authorization patterns including OAuth 2.0, OIDC, JWT, and API key management.
Responsibilities
- Lead agentic AI development, including multi-agent orchestration patterns, agent-to-agent protocols, and reliable tool use at production scale.
- Own prompt engineering and evaluation workflows including structured outputs, hallucination reduction, and behavioral consistency.
- Build and own MCP server infrastructure that exposes backup data to AI agents via the Model Context Protocol, enforcing tenant-aware RBAC, query constraints, and safe tool boundaries.
- Define AI quality benchmarks for retrieval relevance, summarization accuracy, and agent reliability.
- Champion security and safety in AI systems, including adversarial prompt hardening, jailbreak resistance, data boundary enforcement, and OWASP LLM Top 10 awareness.
- Tune AI workflows for performance, cost, latency, and observability across billions of documents in global regions.
- Mentor engineers on the team, raise the technical bar, and contribute to architecture reviews and design decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
