AI Policy Generalist
New
H
HandshakeAI Data
Remote (USA), 8AM - 5PM PTFull-Time
Salary45 - 55 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Quality Assurance
Requirements
- Ability to make precise distinctions between cases with nuanced differences.
- Ability to hold a strong opinion without attachment to being right.
- Clear, precise written communication skills.
- Ability to separate personal views from the customer's policy standard.
- Ability to remain careful and consistent during repetitive, feedback-heavy work.
- Intellectual curiosity and ability to learn unfamiliar subject matter quickly.
- Comfort discussing disagreement directly and respectfully.
- Ability to treat sensitive information and difficult subject matter with maturity and sound judgment.
- Availability to work Monday through Friday, 8AM - 5PM PT.
Responsibilities
- Learn new customer policies, definitions, taxonomies, and evaluation rubrics quickly.
- Evaluate user requests and AI model responses within the full relevant conversation context.
- Distinguish between closely related labels, severity levels, and policy boundaries.
- Select the most defensible classification when a case is genuinely ambiguous.
- Write concise, evidence-based rationales that cite relevant policy language and conversation details.
- Identify policy gaps, contradictions, unclear definitions, and emerging edge cases.
- Raise thoughtful questions when existing guidance does not resolve a case.
- Participate actively in calibration discussions with evaluators, project leads, policy teams, and researchers.
- Help improve evaluation frameworks, examples, decision rules, and quality standards.
View Full Description & ApplyYou'll be redirected to the employer's site
