Senior Open-Source Engineer (Remote) – AI Task Evaluator

YO AI Labs; Washington (District of Columbia); On-site; USD 83,000 - 124,000; Full time

Job summary

YO AI Labs is seeking experienced Senior Software Engineers with strong open-source profiles to create and evaluate challenging software engineering tasks for AI training. You will build reproducible environments and reference solutions to test AI models on debugging, feature development, refactoring, and performance optimization.

This remote contractor role (~15 hrs/week) requires proficiency in Python, Java, Rust, C++, TypeScript, and a track record of contributing to large codebases.

Qualifications

• Experience with designing and implementing tasks for AI evaluation.
• Strong open-source contributions on GitHub or GitLab.
• Ability to work across Python, Java, Rust, C++, Go, and TypeScript codebases.

Responsibilities

• Create expert-level software engineering tasks including bug fixing and feature implementation.
• Develop reproducible environments and golden reference solutions for AI evaluation.
• Review and validate technical submissions for quality and accuracy.
• Document reasoning, solutions, and code decisions.
• Debug complex systems and optimize performance.

Skills

Python 3

Java

Rust

C++

TypeScript

Algorithms & Data Structures

Bug Fixing

Feature Implementation

Codebase Refactoring

Performance Optimization

Job description

YO AI Labs is seeking experienced Senior Software Engineers with strong open-source profiles to create and evaluate challenging software engineering tasks for AI training. You will build reproducible environments and reference solutions to test AI models on debugging, feature development, refactoring, and performance optimization.

This remote contractor role (~15 hrs/week) requires proficiency in Python, Java, Rust, C++, TypeScript, and a track record of contributing to large codebases.