Senior Software Engineer, AI Evaluation (Python / TypeScript / Go), Remote Contract

Rustlabs LLC

United States

Remote

USD 74,000 - 124,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rustlabs LLC is seeking senior engineers for a remote contract to design rubrics and evaluation criteria for AI coding tasks. The role involves reviewing and labeling model output and building data generation pipelines. 5+ years hands-on experience with Python, TypeScript, Go or JavaScript is required.

Expect 20 to 40 hours per week with 4 hours overlapping US Pacific time, and an immediate start. This 3-month contract offers top-of-market pay up to $90+ per hour for the most experienced

Qualifications

  • 5+ years hands-on Python, TypeScript, Go or JavaScript.
  • Strong background building and maintaining pipelines and infrastructure.
  • Rubric or preference-data experience is a plus.

Responsibilities

  • Design rubrics and evaluation criteria for coding AI.
  • Review and label model output.
  • Build data generation and evaluation pipelines.

Skills

Python
TypeScript
Go
JavaScript

Job description

Remote contract work for senior engineers: design rubrics and evaluation criteria for coding AI, review and label model output, and build data generation and evaluation pipelines.

5+ years hands-on Python, TypeScript, Go or JavaScript

Strong background building and maintaining pipelines and infrastructure

Rubric or preference-data experience is a plus

20 to 40 hours a week with 4 hours overlapping US Pacific time; 3-month contract, immediate start

Top-of-market pay: up to $90+/hr for the most experienced engineers

US (most states) or Canada

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Evaluation Engineer (Remote Contract, Python/TS/Go)
Senior AI Evaluation Engineer (Remote Contract, Python/TS/Go)

Rustlabs LLC • United States

Remote
USD 74,000 - 124,000
Senior Software Engineer - Python / TypeScript
Senior Software Engineer - Python / TypeScript

Braintrust • United States

Remote
USD 114,000 - 162,000
Senior Software Engineer (Python/TS) for AI Pipelines Remote
Senior Software Engineer (Python/TS) for AI Pipelines Remote

Weekday • United States

Remote
USD 138,000 - 207,000
Senior AI Data Pipeline Engineer — Remote
Senior AI Data Pipeline Engineer — Remote

Crossing Hurdles • United States

Remote
CAD 243,000 - 346,000
Senior Software Engineer: AI Code Evaluation (US/Canada)
Senior Software Engineer: AI Code Evaluation (US/Canada)

RustLabs • United States

Remote
USD 102,000 - 146,000
Remote Senior Software Engineer - Python/TypeScript (Contract)
Remote Senior Software Engineer - Python/TypeScript (Contract)

Braintrust • United States

Remote
USD 114,000 - 162,000
Senior AI Data Pipeline Engineer (Remote, Part-Time)
Senior AI Data Pipeline Engineer (Remote, Part-Time)

Crossing Hurdles • United States

Remote
CAD 243,000 - 346,000
Senior SWE - Python / TypeScript
Senior SWE - Python / TypeScript

Weekday AI • United States

Remote
USD 138,000 - 207,000
Senior Python/FastAPI Backend Engineer, AI Evaluation
Senior Python/FastAPI Backend Engineer, AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Senior Backend Engineer (Python/FastAPI) AI Evaluation
Senior Backend Engineer (Python/FastAPI) AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 83,000