Remote Senior Software Engineer: AI Agent Evaluation

YO AI Labs

Washington (District of Columbia)

Remote

USD 60,000 - 90,000

Part time

2 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization.

No prior AI experience is required.

Qualifications

Proficiency in Python 3, Java, Rust, C++, or TypeScript.
Strong understanding of algorithms and data structures.
Experience with bug fixing and debugging complex software issues.
Proven ability to implement features and refactor codebases.
Strong knowledge of performance optimization and tuning.
Excellent written and verbal communication; detail-oriented.

Responsibilities

Create reinforcement learning environments for software engineering tasks.
Design tasks involving bug fixing, feature development, refactoring, and optimization.
Build deterministic verification systems and golden reference solutions.
Evaluate AI agents' ability to reason through complex codebases using MCP tools.
Develop realistic, reproducible software-engineering scenarios.
Document solutions and provide technical feedback.