Remote Part-Time Open Source & SWE-Bench Evaluator

Anyone AI Inc.; United States; Remote; USD 83,000 - 165,000; Part time

Job summary

Anyone AI is seeking a software engineer experienced in code review and testing to assess real GitHub issues and PRs. You will analyze task reproducibility, dependencies, and test quality to guide acceptance decisions.

This remote, part-time project-based engagement focuses on technical evaluation of unit tests, coverage, and environment compatibility across multi-file codebases. Strong Git/GitHub experience and Python familiarity are valued.

Qualifications

• 3+ years of professional software engineering experience with multi-file codebases.
• Strong understanding of unit testing, test coverage, and dependency management.
• Experience with Git and GitHub workflows; ability to analyze complex problems.

Responsibilities

• Review coding tasks derived from real GitHub issues and PRs to assess technical soundness and reproducibility.
• Evaluate unit tests for correctness, coverage, and robustness, identifying flaky tests, missing dependencies, version conflicts, and environment issues.
• Determine reproducibility across environments and provide clear recommendations on acceptance.

Skills

Software engineering

Unit testing

Git/GitHub workflows

Tools

Python frameworks

Docker

CI/CD

pip

conda

Job description

Anyone AI is seeking a software engineer experienced in code review and testing to assess real GitHub issues and PRs. You will analyze task reproducibility, dependencies, and test quality to guide acceptance decisions.

This remote, part-time project-based engagement focuses on technical evaluation of unit tests, coverage, and environment compatibility across multi-file codebases. Strong Git/GitHub experience and Python familiarity are valued.