Incident Management / Reliability / SRE Evaluator
New
J
JobgetherIT Security
Based in the United StatesContractSenior
Salary80 - 120 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 5+ years
- Required Skills
- Microsoft OfficePowerPointGoogle Workspace
Requirements
- 5+ years of relevant professional experience in incident management, reliability engineering, site reliability engineering (SRE), or closely related disciplines.
- Strong practical understanding of incident response, service reliability, operational processes, troubleshooting, and reliability best practices.
- Ability to critically evaluate technical work products and distinguish accurate, actionable recommendations from flawed or incomplete reasoning.
- Native or professional fluency in English, with strong written communication skills.
- Highly proficient with Microsoft Office and Google Workspace, particularly Google Slides and/or PowerPoint.
- Excellent attention to detail and the ability to identify factual, technical, aesthetic, and presentation-related issues.
- Strong analytical and critical-thinking skills, with the ability to explain technical assessments clearly and objectively.
- Ability to work independently and manage deliverables effectively in a fully remote, asynchronous environment.
- Comfortable adapting established evaluation criteria and applying consistent judgment across a variety of AI-generated outputs.
Responsibilities
- Evaluate AI-generated documents, spreadsheets, slide decks, and other work products against established incident management, reliability, and SRE quality standards.
- Assess generated outputs for technical accuracy, operational rigor, sound judgment, and alignment with real-world reliability practices.
- Identify factual, technical, presentation, and reasoning errors that could affect the quality or usefulness of an AI-generated deliverable.
- Apply subject-matter expertise to determine whether incident-management and reliability recommendations are practical, complete, and appropriately structured.
- Provide clear, concise, and structured written feedback explaining errors, gaps, and opportunities for improvement.
- Help establish and apply domain-specific quality criteria and rubrics when evaluating AI outputs.
- Collaborate asynchronously with the research team to refine evaluation approaches and improve AI performance.
View Full Description & ApplyYou'll be redirected to the employer's site
