Senior AI Code Evaluation Engineer (Remote)

YO AI Labs; Town of Texas (WI); Remote; USD 83,000 - 152,000; Part time

Job summary

YO AI Labs is seeking a Senior Software Engineer (Contractor) to design reinforcement learning environments for software tasks, using MCP tools to evaluate AI models remotely. You will create reproducible environments, deterministic verification, and reference solutions for bug fixing, feature development, refactoring, and performance tuning, with a focus on high-quality software engineering outcomes.

Strong proficiency in multiple languages and algorithms, plus experience with large codebases

Qualifications

• Experience designing reinforcement learning environments for software tasks.
• Ability to build deterministic verification and reference solutions.
• Strong debugging and codebase refactoring capabilities.

Responsibilities

• Create reinforcement learning environments for software engineering tasks.
• Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
• Build deterministic verification systems and golden reference solutions.
• Evaluate AI agents’ ability to reason through complex codebases using MCP tools.
• Develop realistic, reproducible software engineering scenarios.
• Document solutions and provide technical feedback.

Skills

Python

Java

Rust

C++

TypeScript

Algorithms & Data Structures

Bug fixing

Feature development

Code refactoring

Performance optimization

Communication

Remote teamwork

Job description

YO AI Labs is seeking a Senior Software Engineer (Contractor) to design reinforcement learning environments for software tasks, using MCP tools to evaluate AI models remotely. You will create reproducible environments, deterministic verification, and reference solutions for bug fixing, feature development, refactoring, and performance tuning, with a focus on high-quality software engineering outcomes.

Strong proficiency in multiple languages and algorithms, plus experience with large codebases