Contractor: AI Code Evaluation Engineer

turing; San Francisco (CA); Remote; USD 55,000 - 110,000; Full time

Job summary

Turing, based in San Francisco, seeks a Software Engineering Evaluator to help build high-quality datasets for frontier AI models. You will curate code examples and craft precise solutions across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, while improving AI-driven coding workflows.

In this contract role, you will assess AI-generated code for efficiency and reliability, collaborate with researchers, and design verification mechanisms to ensure robust software engineering outcomes

Qualifications

• 3+ years of software engineering experience.
• Strong ability to build full-stack applications and deploy production-grade software.
• Deep understanding of software architecture, design, development, debugging, and code quality.
• Excellent oral and written communication to justify evaluation rationales.

Responsibilities

• Curate code examples and build AI training datasets across languages like Python, JavaScript (ReactJS), C/C++, Java, Rust and Go.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with researchers and cross-functional teams to improve AI-driven coding solutions.
• Develop verification mechanisms to assess software engineering task solutions.

Skills

3+ years exp

Full-stack development

Software architecture

Code quality

Tools

ReactJS

Python

C/C++

Java

Go

Job description

Turing, based in San Francisco, seeks a Software Engineering Evaluator to help build high-quality datasets for frontier AI models. You will curate code examples and craft precise solutions across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, while improving AI-driven coding workflows.

In this contract role, you will assess AI-generated code for efficiency and reliability, collaborate with researchers, and design verification mechanisms to ensure robust software engineering outcomes