Queue Manager / Annotation Lead (Trust & Safety)
New
P
ProlificAI Data Ops
RemoteContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 3+ years
- Required Skills
- SQLQuality Assurance
Requirements
- 3+ years in high-throughput ops (data labeling, trust & safety, BPO, content ops, CX ops, or similar)
- Trust & safety / integrity background required
- Able to identify shallow, low-effort, or phoned-in responses
- Proven queue management under ambiguity (prioritization + execution)
- Strong quality instincts; can spot systematic errors and close the loop with training/QA
- Proficiency with spreadsheets
- English language fluency
Responsibilities
- Manage work queue: intake, triage, prioritization, task assignment, and SLA delivery
- Monitor task queue and backlog control
- Identify and troubleshoot bottlenecks (unclear policy, tooling issues, supply gaps)
- Perform QA: make corrections, provide annotator feedback, flag systematic confusion to Client Delivery Lead
- Monitor quality at project and individual annotator levels
- Drive guideline adherence, run calibration sessions, reduce rework
- Manage annotator performance: unassign underperformers, identify high-performers
- Train new annotators on project guidelines, conduct webinars, and host office hours
- Oversee dedicated Slack channels for annotator support
- Track key metrics: throughput, disagreement rates, defect/rework rates
View Full Description & ApplyYou'll be redirected to the employer's site
