QA Engineer (AI + Backend)

New

apreelHealth tech

Locations: Warszawa, Centrum, Warszawa, Country code: PL; 100% remote, Must work hours that overlap US Mountain Time afternoons (~14:00–18:00 PL time)ContractMiddle

Salary160 - 170 PLN per hour

Apply NowOpens the employer's application page

More jobs in this role

Job Details

Languages: Languages: en C2, pl C2; Strong English
Experience: 3+ years in technical QA or test automation, including API testing on production systems
Required Skills: PythonAPI testingPostmanPrompt Engineering

Requirements

Have 3+ years of experience in technical QA or test automation, including API testing on production systems.
Write and maintain Python test code using pytest and fixtures.
Have strong HTTP and API fundamentals, including REST, JSON, status codes, headers, and authentication tokens.
Have practical experience with Pact consumer-driven contract testing; this is a hard requirement.
Perform security-aware API testing, including authorization boundaries, token handling, and malformed or hostile input.
Define acceptance criteria for non-deterministic outputs using properties and contracts rather than exact wording.
Build LLM evaluation datasets and golden sets, define response-quality metrics, and detect regressions across prompt and model versions.
Use prompt engineering to change prompts and measure effects; understand hallucinations and prompt injection.
Use Postman and Swagger/OpenAPI as regular tools, and Git in a team workflow with branches, pull requests, and reviews.
Use TestRail for test-case management and run tracking.
Be comfortable testing features in Android/iOS mobile products, including app releases and store builds.
Have strong English and work hours overlapping US Mountain Time afternoons (~14:00–18:00 PL time).

Responsibilities

Curate datasets and golden sets, define response-quality metrics, and detect regressions between prompt and model versions.
Define acceptance criteria for non-deterministic output using properties, structures, constraints, and invariants.
Test prompts by measuring changes and probing for hallucinations and prompt injection.
Test REST endpoints, JSON payloads, authentication-token flows, and error handling using Postman and Swagger/OpenAPI specs.
Implement Pact consumer-driven contracts between the mobile app, gateway, and backend services, and verify them on changes.
Test authorization boundaries, token misuse, malformed input, and other API-level abuse cases.
Use logs, traces, and database queries to localize defects to the model, service code, or input data.
Integrate evaluation runs and quality gates into CI/CD pipelines and pull requests.
Track test results in TestRail, manage defects in Jira, and document findings for the team.

View Full Description & ApplyYou'll be redirected to the employer's site