MSR Project - French (France) Culture Expert

New
W
Welo DataAI evaluation
Remote, FranceContract
Salary33 USD per hour
Apply NowOpens the employer's application page

Job Details

Languages
French-speaking
Required Skills
ComplianceQuality AssuranceCritical thinkingResearchWriting

Requirements

  • Find and verify information from multiple sources.
  • Navigate different websites, databases, and documentation.
  • Spot contradictions between sources and identify outdated information.
  • Recognize when information does not apply to a specific locale or context.
  • Pay attention to language nuances, local variations, and edge cases.
  • Iterate and test through trial and error when initial attempts do not work.
  • Clearly articulate instructions and rubrics, including the reasoning behind them.
  • Bring deep familiarity with the relevant locale, including local regulations, business practices, and cultural nuances.
  • A background in research, quality assurance, compliance, or similar precision-focused work is valuable.

Responsibilities

  • Identify realistic search-related failures where an AI model provides inadequate responses.
  • Create search queries to test for potential failures.
  • Test multiple queries, iterating as needed to find failures.
  • Document what went wrong with inadequate responses.
  • Write instructions and evaluation criteria for correct answers.
  • Assess issues involving local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific applicability.
View Full Description & ApplyYou'll be redirected to the employer's site
33 USD per hour
Apply Now