MSR Project - Portuguese (Brazil) Culture Expert
W
Welo DataAI search evaluation
Listing location: Brazil; Workplace type: Remote; Location: RemoteContract
Salary20 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Portuguese-speaking experts
- Required Skills
- Problem SolvingAttention to detailComplianceQuality AssuranceCritical thinkingResearch
Requirements
- Research information across multiple sources and verify its accuracy.
- Navigate different websites, databases, and documentation.
- Spot contradictions between sources and identify outdated information.
- Recognize when information does not apply to a specific locale or context.
- Catch language nuances, local variations, and edge cases.
- Iterate and test when initial attempts do not work.
- Clearly write instructions and rubrics that explain the reasoning behind evaluations.
- Bring deep familiarity with the relevant locale, including local regulations, business practices, and cultural nuances.
- Background in research, quality assurance, compliance, or similar precision-focused work is valuable.
Responsibilities
- Identify realistic search-related failures where an AI model provides inadequate responses.
- Create search queries and test them, including multiple queries when needed to find failures.
- Document what went wrong with the AI model's responses.
- Write instructions and evaluation criteria for correct answers.
- Assess local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific applicability.
View Full Description & ApplyYou'll be redirected to the employer's site
