Contractor AI-Focused Full-Stack Engineer (Python/JS)

Turing; Pittsburgh (Allegheny County); Remote; USD 83,000 - 138,000; Part time

Job summary

Turing is seeking a Software Engineering evaluator to help create cutting-edge datasets for training and benchmarking large language models. The role emphasizes Python across backend services, data pipelines, and ML infrastructure, with additional work in JavaScript (ReactJS), C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability, and work with cross‑functional teams to enhance AI‑driven coding solutions.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in Python with production-grade software practices.
• Experience building full‑stack apps and deploying scalable software.
• Deep understanding of software architecture, design, and debugging.
• Excellent written and spoken communication for clear evaluation rationales.

Responsibilities

• Work on AI model training by curating code examples, building solutions, and correcting code in Python and other languages.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross‑functional teams to improve AI‑driven coding solutions.
• Develop agents and verification tools in Python to assess code quality and detect error patterns.
• Reason about steps in the software engineering cycle and evaluate model capabilities.
• Design verification mechanisms to automatically validate solutions to programming tasks.

Skills

Python

JavaScript/React

C/C++

Java

Rust

Go

Job description

Turing is seeking a Software Engineering evaluator to help create cutting-edge datasets for training and benchmarking large language models. The role emphasizes Python across backend services, data pipelines, and ML infrastructure, with additional work in JavaScript (ReactJS), C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability, and work with cross‑functional teams to enhance AI‑driven coding solutions.