SWE-Bench AI Task Auditor
New
I
Invisible TechnologiesAI Training
RemoteContract
Salary70 - 100 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Software Engineering
Requirements
- Professional experience in software engineering.
- Deep technical knowledge of complex codebase navigation.
- Experience with real-world application development.
- Familiarity with SWE-Bench standards.
- Strong analytical and problem-solving skills.
- Ability to rigorously test and evaluate complex technical scenarios.
- Supply a secure computer and high-speed internet.
Responsibilities
- Assess whether software engineering tasks are technically accurate, realistic, solvable, and reproducible.
- Verify that tasks are supported by reliable tests and evaluation criteria.
- Perform technical auditing of AI training workflows.
- Provide clear and actionable feedback on identified codebase integration issues.
- Identify and report test failures or logic errors within tasks.
View Full Description & ApplyYou'll be redirected to the employer's site
