AI Content Analyst
New
G
Gramian Consulting GroupAI Evaluation
Spain. Argentina. Mexico. Colombia. Peru, local time zoneContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Spanish
- Required Skills
- Prompt Engineering
Requirements
- Strong Spanish proficiency (reading & writing required)
- Extensive experience using Gemini, Youtube, Gmail, and having Personal Intelligence enabled
- Strong analytical thinking and ability to assess nuanced AI outputs
- Excellent written communication skills with ability to produce structured evaluation notes
- High attention to detail when comparing similar responses
- Ability to work independently in a fully remote environment
- Reliable desktop/laptop and stable internet connection
- Willingness to use your primary personal Google account and enable personal data sources for evaluation purposes
Responsibilities
- Design and run short multi-turn conversations (typically 1–5 turns) intended to test AI personalization behavior
- Create prompts grounded in realistic personal scenarios to evaluate contextual understanding
- Review AI responses to determine whether personalization is correctly applied
- Check grounding quality to ensure the model does not invent unsupported claims about the user
- Evaluate integration quality — confirming personal signals are used naturally (not forced or robotic)
- Compare two responses side-by-side and determine which is more helpful, natural, and relevant
- Write clear, structured rationales explaining rankings and referencing specific conversation turns
- Verify debug information showing whether correct data sources were used
- Maintain strict workflow hygiene (including deleting evaluation conversations when required)
View Full Description & ApplyYou'll be redirected to the employer's site
