Open Source Maintainer - Remote AI Code Evaluation Engineer

Synthires

California

Remote

USD 170,000 - 243,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cincinnatus LLC is seeking experienced open-source maintainers and core contributors to support the development and evaluation of advanced AI models. You will apply hands-on engineering expertise, code review judgment, and deep knowledge of a mature open-source codebase to create realistic engineering tasks and evaluate AI-generated code.

The role involves designing realistic engineering tasks, creating reference solutions, reviewing AI-generated code and tests, and collaborating with experts.

Qualifications

  • Must be a maintainer or core contributor of a widely used open-source project.
  • Verifiable history of sustained open-source contributions through your GitHub account.
  • Senior-level code review skills and ability to assess AI-generated code and edge cases.
  • Hands-on experience building and testing projects locally, including with Docker.
  • Strong written communication and technical reasoning skills.

Responsibilities

  • Develop realistic engineering tasks based on an open-source project you know well, including features, refactoring, and bug fixes.
  • Create accurate reference solutions and evaluation materials.
  • Review AI-generated code, tests, and grading rubrics against repository architecture and quality standards.
  • Build, run, and test projects locally, including using Docker.
  • Provide detailed technical feedback and explain the strengths and weaknesses of AI-generated solutions.
  • Collaborate with subject matter experts to maintain consistent and accurate training data.

Skills

Open source maintainer
Core contributor
Code review
GitHub history
Technical writing

Tools

Docker

Job description

Cincinnatus LLC is seeking experienced open-source maintainers and core contributors to support the development and evaluation of advanced AI models. You will apply hands-on engineering expertise, code review judgment, and deep knowledge of a mature open-source codebase to create realistic engineering tasks and evaluate AI-generated code.

The role involves designing realistic engineering tasks, creating reference solutions, reviewing AI-generated code and tests, and collaborating with experts.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Remote Open-Source Maintainer & AI Code Evaluator
Senior Remote Open-Source Maintainer & AI Code Evaluator

Synthires • United States

Remote
USD 170,000 - 243,000
Senior Open Source Maintainer (Remote) & Core Contributor
Senior Open Source Maintainer (Remote) & Core Contributor

Synthires • United States

Remote
USD 170,000 - 243,000
Open Source Developer (Remote | $150/hr)
Open Source Developer (Remote | $150/hr)

Synthires • United States

Remote
USD 170,000 - 243,000
Open Source Developer (Remote | $150/hr)
Open Source Developer (Remote | $150/hr)

Synthires • California

Remote
USD 170,000 - 243,000
Open Source Software Engineer (Remote | $150/hr)
Open Source Software Engineer (Remote | $150/hr)

Synthires • California

Remote
USD 170,000 - 243,000
Open Source Software Engineer (Remote | $150/hr)
Open Source Software Engineer (Remote | $150/hr)

Synthires • United States

Remote
USD 170,000 - 243,000
Remote Open Source Maintainer & AI Code Reviewer
Remote Open Source Maintainer & AI Code Reviewer

AuraOne Human Data • United States

Remote
USD 170,000 - 243,000
Open Source Maintainer / Core Contributor – Software Engineer
Open Source Maintainer / Core Contributor – Software Engineer

Mercor • United States

Remote
USD 170,000 - 243,000
Remote AI Research & Code Evaluation Engineer
Remote AI Research & Code Evaluation Engineer

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Remote AI Code Benchmark Engineer
Remote AI Code Benchmark Engineer

Turing • United States

Remote
USD 83,000 - 152,000
Fully remote
Cutting-edge AI projects