Program Lead
New
J
JobgetherAI data operations
Based in the United StatesFull-TimeLead
Salary45 - 70 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- At least three years of experience leading or coordinating large groups of contributors, subject matter experts, or domain specialists
- Required Skills
- SQLMicrosoft ExcelTeam managementGoogle Sheets
Requirements
- Experience as an Expert Program Manager, AI Program Lead, Team Lead, or similar, overseeing AI training data, human data, or model evaluation projects.
- At least three years leading or coordinating large groups of contributors, subject matter experts, or domain specialists against deadlines and quality standards.
- Demonstrated career progression in AI data operations or expert management, such as progression from expert contributor to reviewer, team lead, or program lead.
- Familiarity with collecting, reviewing, annotating, validating, and evaluating data used to train or assess AI models.
- Ability to communicate guidelines, evaluation standards, quality decisions, and feedback clearly in writing.
- Ability to assess quality trends, identify root causes, interpret performance metrics, and implement practical solutions.
- Strong organizational skills, attention to detail, and ability to manage multiple priorities while meeting deadlines.
- Ability to collaborate with research, product, and operations stakeholders, translate technical requirements into practical instructions, and resolve issues.
- Ability to commit to a full-time schedule of at least 40 hours per week during weekdays and maintain consistent availability.
- Preferred: Previous involvement in AI training or expert management projects, or internal AI operations teams.
- Preferred: A degree in a science, technology, engineering, or mathematics (STEM) discipline.
- Preferred: Advanced proficiency in Google Sheets or Microsoft Excel, working knowledge of SQL, and some coding experience.
- Preferred: Experience managing large contributor teams, coaching experts, facilitating performance reviews, and maintaining quality standards across distributed groups.
Responsibilities
- Coordinate large pools of domain experts and contributors, oversee onboarding, facilitate team calls and weekly reviews, and keep deliverables aligned with deadlines and quality expectations.
- Translate research objectives and technical requirements into task instructions, evaluation criteria, and operational guidelines.
- Track deliverables, productivity, throughput, and quality metrics using spreadsheets and reporting tools, and update stakeholders on progress and risks.
- Review expert submissions, evaluate quality trends, identify recurring errors, and provide structured written feedback.
- Analyze operational challenges and quality gaps, identify root causes, and implement improvements to contributor effectiveness and program efficiency.
- Identify potential delays, quality issues, and resource constraints, and coordinate solutions with research, product, and operations teams.
- Collaborate with research teams, product partners, operations specialists, and subject matter experts to align expectations and support program execution.
- Help ensure human-generated training data and model evaluation outputs meet standards for improving AI models.
- Set expectations, reinforce quality standards, support contributor development, and promote accountability.
- Balance quality, throughput, and deadlines while keeping large-scale AI data programs organized and aligned with research priorities.
View Full Description & ApplyYou'll be redirected to the employer's site
