Remote AI Code Evaluator (Contractor)

turing; San Francisco (CA); Remote; USD 69,000 - 138,000; Part time

Job summary

Turing, based in San Francisco, is hiring a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code snippets across Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS), and evaluate AI-generated code for efficiency and reliability.

You will work with researchers and engineers to enhance enterprise AI-driven coding solutions, focusing on systems-level correctness and performance while maintaining clear evaluation

Qualifications

• 3+ years of software engineering experience.
• Strong systems/backend expertise.
• Experience with Python, C/C++, Rust, Go.
• Ability to evaluate AI-generated code and provide precise feedback.

Responsibilities

• Curate, build, and correct code examples across Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS).
• Evaluate AI-generated code for correctness, performance, and reliability.
• Collaborate with researchers and engineers to improve AI-driven coding solutions.
• Develop verification mechanisms for software engineering tasks and API designs.
• Support dataset creation for training and benchmarking models.

Skills

Software engineering

Systems programming

Backend development

Python

C/C++

Rust

Go

JavaScript

ReactJS

Job description

Turing, based in San Francisco, is hiring a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code snippets across Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS), and evaluate AI-generated code for efficiency and reliability.

You will work with researchers and engineers to enhance enterprise AI-driven coding solutions, focusing on systems-level correctness and performance while maintaining clear evaluation