Senior Open-Source Engineer (Remote) – AI Task Evaluator

YO AI Labs

Washington (District of Columbia)

Remote

USD 83,000 - 124,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

YO AI Labs is seeking experienced Senior Software Engineers with strong open-source profiles to create and evaluate challenging software engineering tasks for AI training. You will build reproducible environments and reference solutions to test AI models on debugging, feature development, refactoring, and performance optimization.

This remote contractor role (~15 hrs/week) requires proficiency in Python, Java, Rust, C++, TypeScript, and a track record of contributing to large codebases.

Qualifications

  • Experience with designing and implementing tasks for AI evaluation.
  • Strong open-source contributions on GitHub or GitLab.
  • Ability to work across Python, Java, Rust, C++, Go, and TypeScript codebases.

Responsibilities

  • Create expert-level software engineering tasks including bug fixing and feature implementation.
  • Develop reproducible environments and golden reference solutions for AI evaluation.
  • Review and validate technical submissions for quality and accuracy.
  • Document reasoning, solutions, and code decisions.
  • Debug complex systems and optimize performance.

Skills

Python 3
Java
Rust
C++
TypeScript
Algorithms & Data Structures
Bug Fixing
Feature Implementation
Codebase Refactoring
Performance Optimization

Job description

YO AI Labs is seeking experienced Senior Software Engineers with strong open-source profiles to create and evaluate challenging software engineering tasks for AI training. You will build reproducible environments and reference solutions to test AI models on debugging, feature development, refactoring, and performance optimization.

This remote contractor role (~15 hrs/week) requires proficiency in Python, Java, Rust, C++, TypeScript, and a track record of contributing to large codebases.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Open-Source Engineer for AI Evaluation (Remote)
Senior Open-Source Engineer for AI Evaluation (Remote)

YO AI Labs • California City (CA)

Remote
USD 90,000 - 150,000
Senior Open-Source Software Engineer (Remote) for AI Tasks
Senior Open-Source Software Engineer (Remote) for AI Tasks

YO AI Labs • Texas City (TX)

Remote
USD 137,000 - 273,000
Senior Open-Source Engineer - Remote AI Task Designer
Senior Open-Source Engineer - Remote AI Task Designer

YO AI Labs • Philadelphia

Remote
USD 2,700 - 5,500
Senior Open-Source Engineer (Remote) - AI Task Architect
Senior Open-Source Engineer (Remote) - AI Task Architect

YO AI Labs • Austin (TX)

Remote
USD 83,000 - 138,000
Remote Senior Software Engineer — Open Source for AI Tasks
Remote Senior Software Engineer — Open Source for AI Tasks

YO AI Labs • Illinois City (IL)

Remote
USD 47,000 - 58,000
Senior Open-Source Engineer (Remote) - AI Task Developer
Senior Open-Source Engineer (Remote) - AI Task Developer

YO AI Labs • Dallas (TX)

Remote
USD 60,000 - 96,000
Remote Senior Software Engineer Open-Source AI Evaluations
Remote Senior Software Engineer Open-Source AI Evaluations

YO AI Labs • Houston (TX)

Remote
USD 50,000 - 80,000
Senior Software Engineer (Remote) - Open-Source AI Tasks
Senior Software Engineer (Remote) - Open-Source AI Tasks

YO AI Labs • New York (NY)

Remote
USD 110,000 - 165,000
Senior Open-Source Engineer for AI Tasks (Remote)
Senior Open-Source Engineer for AI Tasks (Remote)

YO AI Labs • Atlanta (GA)

Remote
USD 96,000 - 165,000
Remote Senior Open-Source Engineer - AI Task Developer
Remote Senior Open-Source Engineer - AI Task Developer

YO AI Labs • Seattle (WA)

Remote
USD 90,000 - 130,000