Language Model Analyst
M
MercorAI/ML Evaluation
United StatesContract
Salary15 - 20 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English, Kannada
- Required Skills
- EditingLLMWritingAnalytical thinking
Requirements
- Bachelor's degree.
- Native speaker in Kannada.
- Excellent writing skills in English.
- Significant experience using large language models (LLMs).
- Strong attention to detail.
- Background or experience in domains requiring structured analytical thinking.
- Prior experience with RLHF, model evaluation, or data annotation work (preferred).
- Experience writing or editing high-quality written content (preferred).
- Experience comparing multiple outputs and making fine-grained qualitative judgments (preferred).
Responsibilities
- Conduct fact-checking using trusted public sources and external tools.
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
View Full Description & ApplyYou'll be redirected to the employer's site
