Java AI Code Evaluator (Contract, 10–40 hrs/wk)

Turing; New York (NY); On-site; USD 83,000 - 165,000; Part time

Job summary

Turing is seeking a Software Engineering evaluator to create high-quality datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct AI-generated code primarily in Java, while also using Python, JavaScript, C/C++, Rust, and Go.

You will collaborate with researchers and cross-functional teams to enhance enterprise-level AI-driven coding solutions and build verification mechanisms that check code quality and identify error

Qualifications

• Several years of software engineering experience (3 years or more).
• Expertise in building full-stack applications and deploying scalable production software.
• Deep understanding of software architecture, design, development, debugging, and code quality.

Responsibilities

• Curate code examples and build solutions primarily in Java and other languages.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with researchers and cross-functional teams on AI-driven coding solutions.
• Build agents to verify code quality and identify error patterns.
• Design verification mechanisms to automatically verify software engineering tasks.

Skills

Software engineering

Full-stack development

Code review

Communication skills

Tools

Java

Python

JavaScript

C/C++

Rust

Go

Job description

Turing is seeking a Software Engineering evaluator to create high-quality datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct AI-generated code primarily in Java, while also using Python, JavaScript, C/C++, Rust, and Go.

You will collaborate with researchers and cross-functional teams to enhance enterprise-level AI-driven coding solutions and build verification mechanisms that check code quality and identify error