QA Engineer – Agentic Memory Testing
New
I
IntelliasAI Platform
PolandFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- PythonArtificial IntelligenceQAAPI testingRegression testingLangChain
Requirements
- 4+ years QA engineering for AI/ML or conversational AI systems.
- Proficiency in agent memory functional testing (short-term and long-term memory).
- Experience with memory extraction validation and retrieval testing.
- Expertise in testing memory lifecycle behaviors (TTL expiration, deletion, namespace isolation).
- Strong Python test automation skills for API-driven services.
- Experience in agent regression testing to maintain response quality.
- Testing stateful agent behaviors including context retention and personalization.
- Knowledge of LangChain or LangGraph (nice to have).
- Experience with Conversational AI evaluation (nice to have).
- Familiarity with GDPR compliance and user deletion validation (nice to have).
Responsibilities
- Design and execute functional tests for short-term and long-term agent memory.
- Validate in-session context continuity and cross-session memory recall.
- Test memory extraction strategies to ensure that summaries, facts, and preferences are captured correctly.
- Validate memory retrieval to ensure agents retrieve relevant context while filtering irrelevant information.
- Test memory lifecycle behaviors, including TTL expiration, deletion, and namespace isolation.
- Develop Python-based automated tests for agent memory workflows and API-driven services.
- Perform regression testing to ensure memory changes do not negatively affect agent response quality.
- Validate stateful agent behaviors including context retention and personalization.
- Test memory isolation to prevent inappropriate context sharing between users, sessions, or agents.
- Validate user deletion and privacy-related memory workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
