Senior Software Engineer: AI Code Evaluation (Remote)

Vettedlance; United States; Remote; USD 110.000 - 165.000; Teilzeit

Benefits dieser Stelle

Remote work

Hourly freelance contract

Part-time (10-40 hrs/week)

Zusammenfassung

Vettedlance is seeking senior software engineers to review and grade long-horizon coding work by AI agents in real repositories.

You will review agent trajectories, write reference solutions and tests in Python or C++, and judge code quality, security and maintainability against a rubric.

Explain the root cause when an agent's fix fails, and work remotely on an hourly contract with 10-40 hours per week, paid weekly in USD after a short paid assessment.

Qualifikationen

• 5+ years of professional software engineering experience.
• Expert in Python or C++.
• Fluent written English.
• Comfortable reading unfamiliar codebases and writing tests.

Aufgaben

• Review agent trajectories on multi-file, long-horizon coding tasks and score each step.
• Write reference solutions and tests in Python or C++.
• Judge code quality, correctness, security and maintainability against a rubric.
• Explain the root cause when an agent's fix fails.

Kenntnisse

Python

C++

Code review

Testing

English proficiency

Jobbeschreibung

Vettedlance is seeking senior software engineers to review and grade long-horizon coding work by AI agents in real repositories.

You will review agent trajectories, write reference solutions and tests in Python or C++, and judge code quality, security and maintainability against a rubric.

Explain the root cause when an agent's fix fails, and work remotely on an hourly contract with 10-40 hours per week, paid weekly in USD after a short paid assessment.