Senior AI DevOps Developer
New
J
JobgetherAI DevOps Platform
Our partner is looking for a Senior AI DevOps Developer based in United States. Remote work opportunity within Canada.Full-TimeSenior
SalaryCompetitive annual base salary of $150,000–$206,000 CAD for candidates based in Canada.
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPythonKubernetesGoCI/CDLinuxTerraformLLM
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or a related technical discipline, or equivalent professional experience.
- 5+ years of experience designing, deploying, operating, and troubleshooting modern cloud-based or on-premises infrastructure, DevOps platforms, or SaaS/PaaS environments.
- Hands-on experience building and supporting production AI applications, including LLM applications, AI agents, generative AI solutions, or workflow automation.
- Strong understanding of the modern LLM application stack, including prompt engineering, RAG, embeddings, vector search, reranking, context management, structured outputs, tool use, evaluations, and AI security.
- Experience with AWS generative AI technologies, particularly Amazon Bedrock and AgentCore.
- Familiarity with agentic orchestration frameworks and interoperability protocols such as MCP and ACP.
- Strong experience designing and operating CI/CD pipelines, infrastructure-as-code, artifact management, and containerized deployment environments.
- Hands-on knowledge of technologies such as Kubernetes, Terraform, ArgoCD, Artifactory, Jenkins, and Git.
- Strong Linux administration and troubleshooting capabilities, including log analysis, system diagnostics, SSH, certificates, and security fundamentals.
- Programming or scripting experience with Python, Go, Groovy, or comparable languages.
- Experience integrating monitoring and observability solutions such as Grafana, OpenSearch, Prometheus, InfluxDB, Zabbix.
Responsibilities
- Design, implement, deploy, and operate an internal AI tools and platform ecosystem that supports engineering productivity and innovation.
- Build and improve CI/CD pipelines for AI-enabled development workflows, including model, prompt, and evaluation deployment processes.
- Develop robust versioning, cost-tracking, monitoring, testing, and rollback strategies for AI models, prompts, and related services.
- Integrate AI technologies and services such as Amazon Bedrock, AI agents, workflow automation platforms, and supporting infrastructure.
- Apply DevOps and platform engineering best practices to improve the performance, durability, availability, and reliability of AI services.
- Design and maintain infrastructure-as-code, containerized deployments, artifact management, and continuous delivery environments.
- Participate in security reviews and compliance initiatives, implementing appropriate access controls and security safeguards.
- Troubleshoot operational incidents and conduct root-cause analysis to ensure system reliability.
View Full Description & ApplyYou'll be redirected to the employer's site
