Senior QA AI Engineer

New

JobgetherAI software

Full-time remote opportunity based in India.Full-TimeSenior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Experience: 5–7 years of experience in software quality engineering
Required Skills: PostgreSQLJavaJUNITMicrosoft SQL ServerSeleniumRESTful APIsLLM

Have 5–7 years of experience in software quality engineering.
Bring hands-on experience testing Java-based backend services and REST APIs.
Use test automation frameworks such as Selenium, TestNG, JUnit, RestAssured, or Cucumber.
Have experience with relational databases, particularly PostgreSQL and Microsoft SQL Server, including data validation and integrity testing.
Have hands-on experience testing LLM features, including output validation, semantic evaluation, hallucination detection, regression testing, and streaming API behavior.
Be familiar with Model Context Protocol (MCP) and agentic AI testing patterns, including tool-use accuracy and context management.
Have experience conducting AI security testing, including prompt injection, jailbreak, adversarial testing, and sensitive data leakage assessments.
Understand software design principles, microservices architectures, and system-level test strategy development.
Have experience with cloud platforms, preferably AWS and Microsoft Azure.
Hold a Bachelor’s or Master’s degree in Computer Science, Mathematics, Physics, or a related technical field.
Have experience mentoring engineers and contributing to continuous improvement in testing standards and processes.

Lead quality engineering and AI testing initiatives for reliable, scalable, secure cloud-based software.
Design and maintain automated test suites for Java backend services and REST APIs.
Own testing strategies for AI features, including LLM output validation, regression baselines, tool-call accuracy, and end-to-end integration.
Develop CI evaluation frameworks using rubric-based scoring, prompt regression suites, and behavioral drift detection.
Collaborate with product owners, software engineers, and machine learning engineers on testable requirements and acceptance criteria.
Validate data integrity and backend workflows using PostgreSQL and Microsoft SQL Server.
Conduct AI security testing for prompt injection, adversarial inputs, jailbreaks, and sensitive data leakage.
Integrate automated testing into CI/CD pipelines and establish quality gates and deployment controls.
Monitor and report quality, performance, and AI observability metrics.
Mentor quality engineering team members and improve testing processes and methodologies.

View Full Description & ApplyYou'll be redirected to the employer's site