Senior AI Software Evaluator — Python & ML Infra

AI Trainer Gigs

San Francisco (CA)

On-site

USD 83,000 - 138,000

Part time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing in San Francisco is seeking a Software Engineering evaluator to help create cutting‑edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions, primarily in Python, with additional work in JavaScript (including ReactJS), C/C++, Java, Rust, and Go across backend services, data pipelines, and ML infrastructure.

Daily tasks include evaluating and refining AI-generated code for efficiency, collaborating with researchers and

Qualifications

  • 3+ years of software engineering experience.
  • Proficient in Python with production-grade practice.
  • Experience building full-stack apps and deploying scalable software.
  • Strong understanding of software architecture and code quality.
  • Excellent oral and written communication skills.

Responsibilities

  • Curate code examples and build solutions in Python (and JS) for AI training.
  • Evaluate and refine AI-generated code for efficiency and scalability.
  • Collaborate with cross-functional teams on AI-driven coding solutions.
  • Build Python-based verification tools and error-pattern detectors.
  • Hypothesize about software lifecycle steps and evaluate model capabilities.
  • Design verification mechanisms for software tasks.

Skills

3+ years of software eng experience
Python engineering expert
Full-stack app development
Software architecture & quality
Clear written communication

Tools

ReactJS

Job description

Turing in San Francisco is seeking a Software Engineering evaluator to help create cutting‑edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions, primarily in Python, with additional work in JavaScript (including ReactJS), C/C++, Java, Rust, and Go across backend services, data pipelines, and ML infrastructure.

Daily tasks include evaluating and refining AI-generated code for efficiency, collaborating with researchers and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Software Evaluator (Python/ML) — Contractor
Remote AI Software Evaluator (Python/ML) — Contractor

Turing • Los Angeles (CA)

Remote
USD 55,000 - 96,000
Remote AI Software Engineer - Python & ML Infra
Remote AI Software Engineer - Python & ML Infra

Turing • San Francisco (CA)

Remote
USD 83,000 - 165,000
Senior Python AI Evaluation Engineer
Senior Python AI Evaluation Engineer

AI Trainer Gigs • San Francisco (CA)

Hybrid
USD 55,000 - 110,000
AI Software Evaluator, Systems & Benchmarking
AI Software Evaluator, Systems & Benchmarking

AI Trainer Gigs • United States

Remote
USD 83,000 - 165,000
Contract AI Software Engineer - Python & ML Infra
Contract AI Software Engineer - Python & ML Infra

Turing • Texas

Remote
USD 83,000 - 152,000
Remote AI Software Evaluator – Full-Stack Engineer (Python)
Remote AI Software Evaluator – Full-Stack Engineer (Python)

Turing • Chicago (IL)

Remote
USD 83,000 - 165,000
Contract AI Software Evaluator – Code & Benchmarking
Contract AI Software Evaluator – Code & Benchmarking

Turing • Pittsburgh

Remote
USD 55,000 - 110,000
Remote AI Code Evaluator: Full-Stack Engineer
Remote AI Code Evaluator: Full-Stack Engineer

Turing • United States

Remote
USD 55,000 - 96,000
Senior Backend Engineer for AI Code Evaluation
Senior Backend Engineer for AI Code Evaluation

HumanitApp • United States

Remote
USD 69,000 - 124,000
AI-Driven Full-Stack Engineer (Python)
AI-Driven Full-Stack Engineer (Python)

Turing • Pittsburgh

Remote
USD 83,000 - 138,000