Project Lead, AI Model Training
New
N
NewtonXAI Data Operations
Remote (US or Canada) or Hybrid (New York City)Full-TimeMiddle
Salary$150-240K total on target compensation
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- Project ManagementPythonSQLQuality Assurance
Requirements
- 3+ years of experience in data labeling, RLHF/SFT, or AI evaluation delivery.
- Proven experience shipping real annotation or evaluation projects at a data labeling company or AI lab.
- Strong operational skills to own quality metrics, debug workflows, and rewrite rubrics.
- Experience in client-facing roles, including running scoping calls and managing technical stakeholders.
- Ability to manage multiple concurrent projects with varying quality bars and annotator pools.
- Analytical rigor with experience using SQL or Python (preferred).
- Builder mindset with experience creating processes from scratch.
- High level of discretion regarding data security and client-confidential information.
Responsibilities
- Translate client needs into bounded statements of work and concrete task designs.
- Configure multi-layer quality pipelines, grading rubrics, and annotator enablement on the platform.
- Manage the annotator pool, including assignments, qualification, and performance tracking.
- Own project quality, throughput, and cost, diagnosing and fixing issues as they arise.
- Serve as the primary client point of contact for updates, quality escalations, and project milestones.
- Assemble and deliver data batches on schedule and conduct post-mortem project reviews.
- Develop repeatable playbooks, templates, and quality standards for the delivery function.
View Full Description & ApplyYou'll be redirected to the employer's site
