SWE-Bench AI Task Auditor - Freelance AI Trainer
J
JobgetherAI Training / Software Engineering
United StatesContract
Salary70 - 100 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Software EngineeringDebugging
Requirements
- Demonstrable professional experience and deep technical expertise in software engineering.
- Experience with complex codebase navigation and real-world application development.
- Strong familiarity with software engineering concepts and SWE-Bench-related requirements.
- Strong analytical and problem-solving skills for testing and evaluating complex technical scenarios.
- Attention to detail in identifying logic, integration, testing, and reproducibility issues.
- Excellent written communication skills for providing precise technical feedback.
- Ability to work independently on project-based freelance assignments.
- Access to a secure computer and reliable high-speed internet connection.
Responsibilities
- Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility, and alignment with established SWE-Bench standards.
- Review complex codebases and real-world application scenarios to determine whether tasks accurately reflect practical software engineering challenges.
- Assess the reliability and completeness of tests, evaluation criteria, and expected outcomes associated with assigned tasks.
- Identify codebase integration issues, logic errors, test failures, and other technical inconsistencies that could affect task quality or evaluation accuracy.
- Troubleshoot complex technical scenarios and provide clear, actionable feedback to improve task implementation and evaluation workflows.
- Apply specialized software engineering knowledge to ensure AI training and evaluation tasks meet high standards of technical rigor and practical relevance.
- Document findings clearly and consistently so that identified issues can be addressed efficiently.
View Full Description & ApplyYou'll be redirected to the employer's site
