AI Trainer (SWE)
Y
YO AI LabsMachine learning
United StatesContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonMachine LearningPyTorchTensorflowscikit-learn
Requirements
- Have prior paid professional experience training, evaluating, benchmarking, or improving AI systems.
- Demonstrate strong practical proficiency in Python.
- Have hands-on experience with machine learning frameworks and tools such as PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or equivalent technologies.
- Understand machine learning workflows, model validation, training methodologies, and performance evaluation.
- Provide publicly verifiable evidence of technical expertise, such as repositories, competition results, models, publications, open-source contributions, benchmarks, experiments, or technical projects.
- Experience creating AI training tasks, reference answers, evaluation rubrics, graders, or benchmark problems is preferred.
- Experience reviewing technical submissions from other AI trainers is preferred.
- Kaggle Expert, Master, or Grandmaster status, or strong results in other technical competitions, is preferred.
- Publications or open-source contributions in machine learning are preferred.
- Experience with long-horizon or agentic AI evaluations is preferred.
Responsibilities
- Create realistic machine learning engineering tasks that challenge advanced AI models.
- Develop detailed task instructions, reproducible environments, reference solutions, and evaluation criteria.
- Evaluate AI-generated code, experiments, analyses, and technical deliverables.
- Identify technical issues involving data leakage, incorrect validation, unstable training, performance limitations, and reproducibility.
- Assess model-generated solutions for correctness, reliability, and technical quality.
- Provide actionable feedback to improve AI model performance and evaluation standards.
View Full Description & ApplyYou'll be redirected to the employer's site