Senior AI Evaluation Engineer (Remote, Part-Time)

YO AI Labs; Illinois; Remote; USD 70,000 - 110,000; Part time

Job summary

YO AI Labs seeks a Senior Software Engineer to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software tasks using MCP tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Qualifications

• Experience across Python, Java, C++, or TypeScript.
• Strong knowledge of algorithms and data structures.
• Proven ability to fix bugs and implement features.
• Ability to refactor large codebases and optimize performance.

Responsibilities

• Create reinforcement learning environments for software tasks.
• Design tasks including bug fixes, feature development, refactoring, and performance optimization.
• Build deterministic verification systems and reference solutions.
• Evaluate AI agents' reasoning on complex codebases using MCP tools.
• Document solutions and provide technical feedback.

Skills

Python

Java

Rust

TypeScript

Algorithms & DS

Bug fixing

Feature impl.

Code refactoring

Performance tuning

Communication

Attention to detail

Job description

YO AI Labs seeks a Senior Software Engineer to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software tasks using MCP tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.