Medical Expert AI Evaluation Specialist
New
W
Weekday AIHealthcare AI
United States. CanadaPart-TimeMiddle
Salary130 - 180 USD per hour
Apply NowOpens the employer's application page
Job Details
Requirements
- Board-certified physician with a current, active, and unrestricted medical license.
- Resident physician in the final year of an accredited residency program.
- Recent residency graduate who is board-eligible.
- Fellow who is board-certified or board-eligible in their primary specialty.
- Strong understanding of evidence-based medicine and clinical practice guidelines.
- Excellent written communication skills.
- Experience with medical education, clinical research, peer review, or healthcare quality initiatives.
- Interest in artificial intelligence and healthcare innovation.
Responsibilities
- Develop realistic, specialty-specific clinical cases covering diagnostic reasoning, treatment planning, risk stratification, and differential diagnosis.
- Produce high-quality clinical responses reflecting attending-level reasoning that aligns with evidence-based practices.
- Assess AI-generated medical responses using structured evaluation frameworks and scoring rubrics.
- Identify strengths, weaknesses, omissions, and reasoning errors in AI outputs and provide detailed written feedback.
- Participate in onboarding and specialty calibration meetings to maintain consistent quality across evaluations.
View Full Description & ApplyYou'll be redirected to the employer's site
