AI Trainer (SWE)

Y
YO AI LabsMachine learning
United StatesContract
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Required Skills
PythonMachine LearningPyTorchTensorflowscikit-learn

Requirements

  • Have prior paid professional experience training, evaluating, benchmarking, or improving AI systems.
  • Demonstrate strong practical proficiency in Python.
  • Have hands-on experience with machine learning frameworks and tools such as PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or equivalent technologies.
  • Understand machine learning workflows, model validation, training methodologies, and performance evaluation.
  • Provide publicly verifiable evidence of technical expertise, such as repositories, competition results, models, publications, open-source contributions, benchmarks, experiments, or technical projects.
  • Experience creating AI training tasks, reference answers, evaluation rubrics, graders, or benchmark problems is preferred.
  • Experience reviewing technical submissions from other AI trainers is preferred.
  • Kaggle Expert, Master, or Grandmaster status, or strong results in other technical competitions, is preferred.
  • Publications or open-source contributions in machine learning are preferred.
  • Experience with long-horizon or agentic AI evaluations is preferred.

Responsibilities

  • Create realistic machine learning engineering tasks that challenge advanced AI models.
  • Develop detailed task instructions, reproducible environments, reference solutions, and evaluation criteria.
  • Evaluate AI-generated code, experiments, analyses, and technical deliverables.
  • Identify technical issues involving data leakage, incorrect validation, unstable training, performance limitations, and reproducibility.
  • Assess model-generated solutions for correctness, reliability, and technical quality.
  • Provide actionable feedback to improve AI model performance and evaluation standards.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now