MSR Project - Korean Culture Expert
New
W
Welo DataAI search evaluation
Remote, KoreaContract
Salary35 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Korean-speaking
- Required Skills
- Problem SolvingAttention to detailComplianceQuality AssuranceCritical thinkingResearchWriting
Requirements
- Find and verify information from multiple sources.
- Navigate different websites, databases, and documentation.
- Spot contradictions between sources and identify outdated information.
- Recognize when information does not apply to a specific locale or context.
- Catch nuances in language, local variations, and edge cases.
- Iterate and test through trial and error when needed.
- Bring domain knowledge in research, quality assurance, compliance, or similar precision-focused work; this is described as ideal.
- Clearly articulate instructions and rubrics so others understand the reasoning.
- Have deep familiarity with the relevant locale, including local regulations, business practices, and cultural nuances.
Responsibilities
- Identify realistic search-related failures where an AI model provides inadequate responses.
- Create search queries and test them, including testing multiple queries when needed to find failures.
- Document what went wrong with the AI model's responses.
- Write instructions and evaluation criteria for correct answers.
- Assess local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability.
View Full Description & ApplyYou'll be redirected to the employer's site
