AI Coding Evaluator

A
Anyone AIAI evaluation
Location: Argentina - Fully Remote Secondary Locations: Uruguay, Chile, Poland, Italy, Czech Republic, Estonia, Ecuador - Fully Remote, Portugal, Mexico - Fully Remote, Paraguay, Colombia - Fully Remote, France, Spain, Peru - Fully Remote, Brazil, GermanyContract
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
Fluency in one or more of the supported language varieties: Dutch (Netherlands), Welsh (United Kingdom), French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), Greek (Greece).
Required Skills
RESTful APIsJSONQuality Assurance

Requirements

  • Be fluent in one or more supported language varieties: Dutch (Netherlands), Welsh (United Kingdom), French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), or Greek (Greece).
  • Have a solid understanding of JSON syntax, structure, validation, and troubleshooting.
  • Have coding knowledge sufficient to assess technical content and identify errors.
  • Apply strong judgment when evaluating customer service responses.
  • Demonstrate excellent attention to detail and strong written communication skills.
  • Follow detailed evaluation guidelines consistently.
  • Previous experience in AI evaluation, quality assurance, or technical support is a plus.
  • Experience with APIs and structured data is a plus.
  • Background in customer service, software development, or technical writing is a plus.

Responsibilities

  • Review AI-generated customer service responses and technical content.
  • Evaluate responses for clarity, helpfulness, natural language, and overall quality.
  • Assess technical correctness using coding knowledge.
  • Read, validate, and troubleshoot JSON, identifying structural and formatting issues.
  • Check outputs for formatting accuracy and adherence to project guidelines.
  • Provide clear, well-reasoned feedback explaining evaluations.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now