AI Code and Data Evaluation Engineer

Turing

Pittsburgh (Allegheny County)

Remote

USD 83,000 - 138,000

Part time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You’ll curate code across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, and assess AI-generated code for efficiency and reliability.

You will collaborate with researchers and cross-functional teams to enhance enterprise AI coding solutions and build verification mechanisms for code quality and error patterns.

Qualifications

  • 3+ years of software engineering experience in full-stack roles.
  • Experience building scalable, production-grade software with modern languages.
  • Strong understanding of architecture, design, and code quality review.
  • Excellent written and verbal communication for evaluation rationales.

Responsibilities

  • Curate and evaluate code examples across Python, JavaScript, C/C++, Java, Rust, and Go.
  • Refine AI-generated code for efficiency, scalability, and reliability.
  • Collaborate with researchers and cross-functional teams on enterprise AI coding solutions.
  • Build verification agents to identify code errors and patterns.
  • Hypothesize software engineering steps and evaluate model capabilities.

Skills

Full-stack dev
Code review
Software architecture
Effective communication

Tools

ReactJS
Python
Java
C/C++

Job description

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You’ll curate code across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, and assess AI-generated code for efficiency and reliability.

You will collaborate with researchers and cross-functional teams to enhance enterprise AI coding solutions and build verification mechanisms for code quality and error patterns.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Code Evaluation Engineer
AI Code Evaluation Engineer

Turing • Chicago (IL)

Remote
USD 69,000 - 103,000
AI Code Evaluation Engineer (Contract)
AI Code Evaluation Engineer (Contract)

Turing • Pittsburgh

Remote
USD 55,000 - 96,000
AI Data & Code Evaluation Engineer - Python Focus
AI Data & Code Evaluation Engineer - Python Focus

Turing • United States

Remote
USD 83,000 - 131,000
AI Code Evaluation Engineer – Frontend & Backend
AI Code Evaluation Engineer – Frontend & Backend

HumanitApp • San Francisco (CA)

On-site
USD 83,000 - 138,000
AI Coding Evaluator — Python Pro (Contractor)
AI Coding Evaluator — Python Pro (Contractor)

Turing • Dallas (TX)

Remote
USD 55,000 - 96,000
Remote work
Flexible schedule
Competitive hourly rate
Contract AI Software Engineer: Code Curation & Evaluation
Contract AI Software Engineer: Code Curation & Evaluation

Turing • Chicago (IL)

Remote
USD 55,000 - 110,000
Flexible hours
Partial PST overlap
AI Software Evaluator, Systems & Benchmarking
AI Software Evaluator, Systems & Benchmarking

AI Trainer Gigs • United States

Remote
USD 83,000 - 165,000
Contract AI Software Evaluator – Code & Benchmarking
Contract AI Software Evaluator – Code & Benchmarking

Turing • Pittsburgh

Remote
USD 55,000 - 110,000
AI Training Data Engineer – Python/JS & React
AI Training Data Engineer – Python/JS & React

Turing • United States

Remote
USD 83,000 - 152,000
Flexible engagement
Remote work within US
Contractor Software Engineer - AI Data & Code Evaluation
Contractor Software Engineer - AI Data & Code Evaluation

Turing Enterprise Inc. • United States

Remote
USD 14,000 - 55,000
Contractor engagement
Flexible hours