Senior AI Platform Engineer
New
J
JustMarketsAI platform
Location: EuropeFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English - Intermediate or higher.
- Experience
- 5+ years of experience in backend development; at least 1 year of hands-on experience working with AI/LLM-based solutions.
- Required Skills
- DockerPythonKubernetesTypeScriptGoRustDistributed Systems
Requirements
- Have 5+ years of experience in backend development.
- Have at least 1 year of hands-on experience working with AI/LLM-based solutions.
- Be proficient in Python or another modern backend language such as Go, TypeScript, or Rust, and be willing to work with Python as the primary platform language.
- Understand distributed systems, including async queues, rate limiting, retries, circuit breakers, and failover mechanics.
- Have practical experience with LLM APIs such as OpenAI, Anthropic, or Gemini, including streaming, tool calling, context management, and rate limits.
- Have hands-on experience building AI agents or agentic workflows.
- Have knowledge of observability, including metrics, logs, and tracing.
- Have experience with Docker, Kubernetes, and AWS or GCP.
- Demonstrate strong logical thinking, ownership, initiative, and a product mindset.
- Have English proficiency at intermediate level or higher.
Responsibilities
- Architect, build, and operate the internal LLM Gateway, including routing, rate limiting, quotas, cost tracking, and automated fallbacks.
- Design and build the agent control plane for agent creation, context management, task execution, and state tracking.
- Build and maintain internal SDKs to simplify LLM integration across teams.
- Implement monitoring, alerting, tracing, and evaluation for LLM and agent workflows.
- Implement security and governance for LLM usage and AI agents.
- Collaborate with internal teams to translate business needs into working AI solutions and drive AI adoption.
- Evaluate build-versus-buy options and integrate relevant open-source tools where appropriate.
View Full Description & ApplyYou'll be redirected to the employer's site
