Senior AI Quality Engineer
New
F
FoodicsRestaurant Management
Cairo, Cairo Governorate, EgyptFull-TimeSenior
SalaryHighly competitive compensation packages, including bonuses and the potential for shares
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonAPI testingCI/CDLLMPlaywright
Requirements
- Professional experience shipping LLM-backed production software used by real users.
- Strong proficiency in Python.
- Comfortable coding in at least one of .NET, Java, or TypeScript.
- Proven experience owning and maintaining test automation suites across backend and UI/mobile.
- Practical experience building and measuring system evaluation frameworks.
- Deep understanding of LLM tooling including prompting, structured output, tool use, and RAG.
- Knowledge of testing fundamentals such as the test pyramid, CI/CD gating, and flake economics.
- Experience with agentic AI orchestration, multi-step planning, and sandboxed execution.
- Ability to design systems for reliability, including structured output, guardrails, and retry logic.
- Familiarity with observability for LLM systems, including tracing and latency monitoring.
Responsibilities
- Develop test automation across backend APIs, web frontends using Playwright, and mobile apps using Appium or Maestro.
- Build evaluation infrastructure for AI features, including datasets, scoring, and regression detection.
- Design agentic AI systems that perform pipeline tasks such as code analysis, failure reproduction, and automated fix proposals.
- Implement orchestration for multi-step AI planning, memory management, and tool integration.
- Maintain CI/CD pipelines, parallelization, and test data management to gate releases effectively.
- Develop performance and load testing strategies for product updates.
- Analyze and triage build failures to distinguish between bugs, flakes, and environment issues.
View Full Description & ApplyYou'll be redirected to the employer's site
