AI Dataset & LLM Software Evaluator (Contract)

HumanitApp

United States

Remote

USD 83,000 - 124,000

Part time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Contractor role

Job summary

Turing, based in San Francisco, invites applications for a Software Engineering evaluator contractor in the United States. You will create datasets, evaluate AI-generated code, and collaborate with researchers to improve large language models.

This role requires 3+ years of software engineering and a track record deploying production-grade software. Flexible engagement, 10–40 hours per week, for one month with potential extension based on performance.

Qualifications

  • 3+ years of software engineering experience.
  • Experience deploying scalable, production-grade software using modern languages and tools.
  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
  • Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

  • Evaluate and refine AI-generated code across backend and frontend contexts.
  • Collaborate with researchers to curate datasets and assess model capabilities.
  • Build verification mechanisms to check code quality and error patterns.

Skills

Software engineering
Production systems
Code review
Communications

Job description

Turing, based in San Francisco, invites applications for a Software Engineering evaluator contractor in the United States. You will create datasets, evaluate AI-generated code, and collaborate with researchers to improve large language models.

This role requires 3+ years of software engineering and a track record deploying production-grade software. Flexible engagement, 10–40 hours per week, for one month with potential extension based on performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Software Engineer: LLM Coding & Eval
Remote AI Software Engineer: LLM Coding & Eval

Turing Enterprise Inc. • United States

Remote
USD 120,000 - 180,000
Senior Python Engineer for AI Data & LLM Training
Senior Python Engineer for AI Data & LLM Training

HumanitApp • United States

Remote
USD 69,000 - 96,000
Remote AI Software Evaluator (Python/ML) — Contractor
Remote AI Software Evaluator (Python/ML) — Contractor

Turing • Los Angeles (CA)

Remote
USD 55,000 - 96,000
Senior Software Engineer – LLM Evaluation (US-based)
Senior Software Engineer – LLM Evaluation (US-based)

Turing • United States

Remote
USD 55,000 - 110,000
Senior Software Engineer – LLM Evaluation (US-based)
Senior Software Engineer – LLM Evaluation (US-based)

AI Trainer Gigs • San Francisco (CA)

On-site
USD 83,000 - 138,000
AI Software Evaluator, Systems & Benchmarking
AI Software Evaluator, Systems & Benchmarking

AI Trainer Gigs • United States

Remote
USD 83,000 - 165,000
Senior Python Engineer - LLM Evaluation (Contract)
Senior Python Engineer - LLM Evaluation (Contract)

AI Trainer Gigs • United States

On-site
USD 83,000 - 138,000
Senior Software Engineer – LLM Evaluation
Senior Software Engineer – LLM Evaluation

Turing • United States

Remote
USD 55,000 - 96,000
Flexible engagement (10–40 hrs/week)
Contractor (no medical/paid leave)
Senior Python Engineer – LLM Evaluation (US-based)
Senior Python Engineer – LLM Evaluation (US-based)

Turing • United States

Remote
USD 69,000 - 96,000
Senior AI Software Evaluator — Python & ML Infra
Senior AI Software Evaluator — Python & ML Infra

AI Trainer Gigs • San Francisco (CA)

On-site
USD 83,000 - 138,000