AI Dataset & Code Evaluation Engineer

Turing; New York (NY); On-site; USD 69,000 - 124,000; Part time

Job summary

Turing is seeking a Software Engineering evaluator to create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

This role involves curating code examples, providing precise solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating AI-generated code for efficiency, scalability, and reliability.

Qualifications

• 3+ years of software engineering experience.
• Strong full-stack and scalable software deployment expertise.
• Deep understanding of architecture, design, debugging, and code quality.
• Excellent oral and written communication for evaluation rationales.

Responsibilities

• Curate code examples and solutions across Python, JS (ReactJS), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams on enterprise AI coding solutions.
• Design verification mechanisms to verify a software engineering task solution.
• Build agents that verify code quality and identify error patterns.

Skills

Python

JavaScript

C/C++

Java

Rust

Go

Full-stack development

Software architecture

Code quality review

Communication

Job description

Turing is seeking a Software Engineering evaluator to create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

This role involves curating code examples, providing precise solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating AI-generated code for efficiency, scalability, and reliability.