Legal Domain Expert (SME) – AI Model Evaluation

J
JobgetherLegal AI
Based in the United StatesContractMiddle
Salary46 USD per hour
Apply NowOpens the employer's application page

Job Details

Experience
3+ years

Requirements

  • Licensed attorney, legal researcher, senior paralegal, or another legal professional with verifiable qualifications.
  • 3+ years of relevant legal practice or legal research experience.
  • Substantial expertise in at least one applicable legal specialty.
  • Strong knowledge of the relevant jurisdiction and demonstrated ability to conduct sophisticated legal research and analysis.
  • Verifiable bar admission, legal license, academic qualification, or other relevant professional credentials.
  • Excellent legal writing, analytical reasoning, fact-checking, and attention-to-detail skills.
  • Ability to evaluate legal arguments objectively and identify subtle factual, jurisdictional, citation, and reasoning errors.
  • Strong understanding of applicable statutes, regulations, case law, legal authorities, and professional standards.
  • Ability to communicate complex legal issues clearly through structured written feedback.

Responsibilities

  • Evaluate AI-generated legal research, analysis, and responses for accuracy, relevance, completeness, and quality.
  • Verify legal citations, authorities, statutes, cases, regulations, and other supporting sources.
  • Assess whether legal reasoning is logically sound, appropriately supported, and accurate for the relevant jurisdiction.
  • Identify factual inaccuracies, unsupported assertions, misleading conclusions, reasoning gaps, and other substantive issues.
  • Evaluate legal drafting for clarity, precision, completeness, and adherence to applicable legal standards.
  • Develop and apply objective evaluation criteria, scoring frameworks, and rubrics for assessing AI-generated legal work.
  • Provide structured, detailed feedback that clearly explains identified issues and distinguishes substantive errors from acceptable variations in legal interpretation.
View Full Description & ApplyYou'll be redirected to the employer's site
46 USD per hour
Apply Now