Senior AI Evaluation Engineer (Remote Contract, Python/TS/Go)

Rustlabs LLC

United States

Remote

USD 74,000 - 124,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rustlabs LLC is seeking senior engineers for a remote contract to design rubrics and evaluation criteria for AI coding tasks. The role involves reviewing and labeling model output and building data generation pipelines. 5+ years hands-on experience with Python, TypeScript, Go or JavaScript is required.

Expect 20 to 40 hours per week with 4 hours overlapping US Pacific time, and an immediate start. This 3-month contract offers top-of-market pay up to $90+ per hour for the most experienced

Qualifications

  • 5+ years hands-on Python, TypeScript, Go or JavaScript.
  • Strong background building and maintaining pipelines and infrastructure.
  • Rubric or preference-data experience is a plus.

Responsibilities

  • Design rubrics and evaluation criteria for coding AI.
  • Review and label model output.
  • Build data generation and evaluation pipelines.

Skills

Python
TypeScript
Go
JavaScript

Job description

Rustlabs LLC is seeking senior engineers for a remote contract to design rubrics and evaluation criteria for AI coding tasks. The role involves reviewing and labeling model output and building data generation pipelines. 5+ years hands-on experience with Python, TypeScript, Go or JavaScript is required.

Expect 20 to 40 hours per week with 4 hours overlapping US Pacific time, and an immediate start. This 3-month contract offers top-of-market pay up to $90+ per hour for the most experienced

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Evaluation (Python / TypeScript / Go), Remote Contract
Senior Software Engineer, AI Evaluation (Python / TypeScript / Go), Remote Contract

Rustlabs LLC • United States

Remote
USD 74,000 - 124,000
Senior Backend Engineer (Python/FastAPI) AI Evaluation
Senior Backend Engineer (Python/FastAPI) AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 83,000
Senior Software Engineer: AI Code Evaluation (US/Canada)
Senior Software Engineer: AI Code Evaluation (US/Canada)

RustLabs • United States

Remote
USD 102,000 - 146,000
Backend Engineer for AI Evaluation Tasks (Remote)
Backend Engineer for AI Evaluation Tasks (Remote)

Weekday AI • United States

Remote
USD 69,000 - 138,000
Remote Senior JS/TS Engineer for AI Evaluation
Remote Senior JS/TS Engineer for AI Evaluation

prolificacademicltd • United States

Remote
USD 57,000 - 81,000
Remote AI Evaluation Engineer (Contract)
Remote AI Evaluation Engineer (Contract)

Alignerr • United States

Remote
USD 83,000 - 165,000
Remote Senior Rust Engineer for AI Code Evaluation & Training
Remote Senior Rust Engineer for AI Code Evaluation & Training

Alignerr • United States

Remote
USD 83,000 - 152,000
Senior Python/FastAPI Backend Engineer, AI Evaluation
Senior Python/FastAPI Backend Engineer, AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Remote Full Stack Engineer
Remote Full Stack Engineer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Backend Engineer for AI Coding Evaluations
Remote Backend Engineer for AI Coding Evaluations

24-MAG • United States

Remote
USD 41,000 - 138,000