Senior AI Engineer, Agentic Platform

New
W
WorkWaveOperational SaaS
Remote (UK-based) with occasional collaborative team meetups.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
5+ years building production software or data-intensive systems used by real customers
Required Skills
AWSPythonSQL

Requirements

  • Have 5+ years of experience building production software or data-intensive systems used by real customers.
  • Bring strong Python skills and have shipped at least one LLM or agent feature to production users.
  • Have hands-on AWS experience; Amazon Bedrock and Bedrock AgentCore experience is preferred.
  • Have experience with agent orchestration, tool and function design, context assembly, and multi-step workflows.
  • Have built retrieval over real business data and be able to explain context selection and answer failures.
  • Bring SQL and metric fluency sufficient to identify when an agent uses the wrong number.
  • Have built or owned an evaluation loop for a generative system, including labeled sets and regression gates.
  • Have shipped product decisions about when an agent should answer, ask, refuse, and show its work.
  • Have quantified agent outcomes such as adoption, task success, or decision quality and presented them to non-technical stakeholders.
  • Have used coding agents on production work and be able to critically verify their output.
  • Have excellent communication and collaboration skills across technical and non-technical teams.

Responsibilities

  • Build production agents and the tools they call, including retrieval, multi-step workflows, and action-taking, on Amazon Bedrock.
  • Turn semantic-layer capabilities and service APIs into endpoints and tools agents can use effectively.
  • Shape the customer experience, including answer speed, confidence, explanations, and next steps.
  • Build an evaluation harness with labeled test sets, groundedness and hallucination measures, and CI regression gates.
  • Measure adoption, feedback, intent, and realized customer impact, and report results to Product and the business.
  • Instrument tracing, diagnose answer failures, and turn failure modes into fixes.
  • Own and operate the serving path, including MCP endpoints, latency, cost per response, caching, and runtime guardrails.
  • Partner with Product Managers and engineers on agent-supported decisions and drive data or infrastructure changes with the platform team.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now