- Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor trap answers across diagnosis and treatment tasks.
- Review vignettes covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
- Score vignette accuracy and completeness, including whether a vignette gives away the answer.
- Assess answer correctness and gradeability, as well as the quality of distractor trap answers.
- Check whether reasoning reaches the answer using vignette facts alone.
- Correct reasoning traces and write short rationales.
- Complete independent blind reads and participate in physician adjudication.