Senior Software Developer, AI Agents
New
K
KnakSaaS Marketing Automation
Remote - CanadaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- AWSDockerNode.jsPHPPythonKubernetesMySQLRESTful APIsLLM
Requirements
- 6+ years of backend software development experience.
- Hands-on experience building LLM-powered agents in production, including tool calling, orchestration, and context management.
- Expertise in designing and running evaluations for LLM systems, including dataset curation and LLM-as-judge pipelines.
- Strong proficiency in Python, Node.js, and MySQL.
- Expertise in RESTful APIs, TDD, and CI/CD workflows using GitHub Actions.
- Experience with SaaS architecture, microservices, and AWS cloud services.
- Knowledge of observability, performance tuning, and scalability.
- Familiarity with Docker and Kubernetes.
- Excellent problem-solving skills and a collaborative mindset.
Responsibilities
- Design and implement the core agent runtime in Python, including orchestration loops, tool definitions, memory management, and failure handling.
- Build and maintain evaluation datasets and automated LLM-as-judge pipelines to measure performance and track regressions.
- Diagnose agent failures, tune prompts, and run benchmarks to improve agent quality.
- Develop Python and Node.js microservices for agent hosting and LLM interaction.
- Maintain Laravel (PHP) APIs to integrate agents into the platform, ensuring performance and testability.
- Manage secure, scalable infrastructure using AWS services such as Lambda, Bedrock, and CDN.
- Optimize MySQL databases to reduce latency and improve query speed.
- Lead code reviews and mentor engineers on agent development and evaluation practices.
View Full Description & ApplyYou'll be redirected to the employer's site