AI Software Development Engineer in Test

New
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
4–10+ years
Required Skills
DockerPythonKubernetesSeleniumCI/CDPrompt EngineeringLangChainPlaywright

Requirements

  • 4–10+ years of software engineering or QA experience
  • 2–4+ years focused on AI/ML, LLMs, or AI-based systems
  • Strong programming skills in Python
  • Deep understanding of QA principles and software testing methodologies
  • Hands-on experience with LLM testing, prompt engineering, RAG systems, and AI evaluation frameworks
  • Experience with APIs, microservices, and UI automation frameworks (Playwright, Selenium, or Robot Framework)
  • Familiarity with CI/CD pipelines and cloud environments (AWS, Azure, GCP, or OCI)
  • Knowledge of Docker, Kubernetes, and distributed system testing
  • Experience with vector databases and AI frameworks (LangChain, LangGraph)
  • Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or equivalent

Responsibilities

  • Drive the adoption of AI-powered testing tools and modern QA practices across engineering teams
  • Design and implement evaluation frameworks for LLMs
  • Build automated pipelines to validate AI outputs
  • Test and validate RAG systems
  • Develop and maintain scalable automation frameworks for UI, API, microservices, and event-driven systems
  • Integrate automated testing and quality gates into CI/CD pipelines
  • Validate AI agent workflows
  • Contribute to observability, monitoring, and reliability improvements for AI systems
  • Collaborate with engineering and product teams to embed AI quality standards
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now