Senior Python Engineer - LLM Evaluation (Contract)

Aitrainergigs

United States

On-site

USD 83,000 - 138,000

Part time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct code in Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS), focusing on systems-level code and performance-critical infrastructure.

You will evaluate AI-generated code for efficiency, scalability, and reliability and collaborate with researchers and product teams to improve enterprise AI

Qualifications

  • Several years of software engineering experience (3+ years).
  • Strong expertise in systems programming, infrastructure, or backend development using languages like Python, C/C++, Rust, and Go.
  • Experience building and deploying scalable, production‑grade software using modern languages and tools.
  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
  • Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

  • Create cutting-edge datasets for training, benchmarking, and advancing LLMs.
  • Curate code examples, provide precise solutions, and correct code in multiple languages.
  • Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
  • Collaborate with cross-functional teams to enhance enterprise‑level AI‑driven coding solutions.
  • Build agents to verify quality of systems-level and infrastructure code.

Skills

3+ years software experience
Systems programming
Backend development
Python
C/C++
Rust
Go
Java
JavaScript
ReactJS

Tools

ReactJS

Job description

Turing is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct code in Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS), focusing on systems-level code and performance-critical infrastructure.

You will evaluate AI-generated code for efficiency, scalability, and reliability and collaborate with researchers and product teams to improve enterprise AI

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Engineer for AI Data & LLM Training
Senior Python Engineer for AI Data & LLM Training

HumanitApp • United States

Remote
USD 69,000 - 96,000
Senior Python Engineer – LLM Evaluation (US-based)
Senior Python Engineer – LLM Evaluation (US-based)

Turing • United States

Remote
USD 69,000 - 96,000
AI Coding Evaluator — Python Pro (Contractor)
AI Coding Evaluator — Python Pro (Contractor)

Turing • Dallas (TX)

Remote
USD 55,000 - 96,000
Remote work
Flexible schedule
Competitive hourly rate
LLM Evaluation Engineer — Contractor (10–40h/wk)
LLM Evaluation Engineer — Contractor (10–40h/wk)

Turing Enterprises, Inc. • San Francisco (CA)

Remote
USD 83,000 - 124,000
Contract AI Software Engineer: Code Curation & Evaluation
Contract AI Software Engineer: Code Curation & Evaluation

Turing • Chicago (IL)

Remote
USD 55,000 - 110,000
Flexible hours
Partial PST overlap
Remote AI Software Evaluator (Python/ML) — Contractor
Remote AI Software Evaluator (Python/ML) — Contractor

Turing • Los Angeles (CA)

Remote
USD 55,000 - 96,000
AI Data & Code Evaluation Engineer - Python Focus
AI Data & Code Evaluation Engineer - Python Focus

Turing • United States

Remote
USD 83,000 - 131,000
Contractor AI-Focused Full-Stack Engineer (Python/JS)
Contractor AI-Focused Full-Stack Engineer (Python/JS)

Turing • Pittsburgh

Remote
USD 83,000 - 138,000
Senior Python Engineer – LLM Evaluation (US-based)
Senior Python Engineer – LLM Evaluation (US-based)

Aitrainergigs • United States

On-site
USD 83,000 - 138,000
Remote Python-Powered AI Full-Stack Engineer
Remote Python-Powered AI Full-Stack Engineer

Turing • Pittsburgh

Remote
USD 55,000 - 117,000