Senior Software Engineer – Open Source & SWE-Bench Evaluation
New
A
Anyone AISoftware Engineering
Argentina - Fully Remote, Uruguay, Chile, Ecuador - Fully Remote, Portugal, Mexico - Fully Remote, Colombia - Fully Remote, Spain, BrazilContractSenior
Salary65 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- DockerPythonGitCI/CDDebuggingGitHubUnit Testing
Requirements
- 3+ years of professional software engineering experience.
- Strong experience working with large, multi-file codebases.
- Experience reviewing pull requests, debugging issues, and maintaining production code.
- Strong understanding of unit testing and test coverage.
- Ability to evaluate test validity without unnecessarily restricting implementation approaches.
- Experience with dependency management, environment setup, and reproducibility.
- Strong understanding of Git and GitHub-based development workflows.
- Ability to analyze complex technical problems and provide clear written feedback.
Responsibilities
- Review coding tasks derived from real GitHub issues and pull requests.
- Assess whether problem statements and success criteria are clear and complete.
- Evaluate unit tests for correctness, coverage, and robustness.
- Identify flaky tests, missing dependencies, version conflicts, and environment issues.
- Determine whether tasks can be reliably reproduced across environments.
- Assess the real-world difficulty and complexity of each task.
- Provide clear recommendations on whether tasks should be accepted, improved, or excluded.
View Full Description & ApplyYou'll be redirected to the employer's site
