SWE-Bench AI Task Auditor
M
MeridialSoftware Engineering
World Wide - RemoteContract
Salary70 - 100 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Software EngineeringTroubleshooting
Requirements
- Demonstrable professional experience in software engineering.
- Deep technical knowledge in complex codebase navigation.
- Experience with real-world application development.
- Knowledge of SWE-Bench standards.
- Strong analytical and problem-solving skills.
- Ability to rigorously test, troubleshoot, and evaluate complex technical scenarios.
- Provision of a secure computer and high-speed internet.
Responsibilities
- Assess whether software engineering tasks are technically accurate, realistic, solvable, and reproducible.
- Verify that tasks are supported by reliable tests and evaluation criteria.
- Perform technical auditing of tasks used to train and evaluate AI systems.
- Provide clear, actionable feedback on identified codebase integration issues.
- Identify and report test failures or logic errors within the tasks.
View Full Description & ApplyYou'll be redirected to the employer's site
