C/C++ Software Engineer for AI Code Evaluation

turing; California (MO); Hybrid; USD 83,000 - 165,000; Part time

Job summary

Turing is seeking a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models, collaborating closely with researchers.

This includes curating code examples, providing precise solutions, and making corrections primarily in C/C++, as well as in Python, JavaScript (including ReactJS), Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance

Qualifications

• Several years of software engineering experience
• Strong expertise in building full-stack applications and deploying scalable, production-grade software
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment
• Excellent oral and written communication skills for clear, structured evaluation rationales

Responsibilities

• Curate code examples and build solutions primarily in C/C++, also using Python, JavaScript (ReactJS), Java, Rust and Go
• Evaluate and refine AI-generated code to ensure it is efficient, scalable, and reliable
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry benchmarks
• Build agents that verify code quality and identify error patterns
• Hypothesize on software engineering cycle steps and evaluate model capabilities on them
• Design verification mechanisms that automatically verify solutions to software engineering tasks

Skills

Software engineering

Full-stack development

Code quality & review

Communication skills

Tools

C/C++

Python

JavaScript/ReactJS

Java

Rust

Go

Job description

Turing is seeking a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models, collaborating closely with researchers.

This includes curating code examples, providing precise solutions, and making corrections primarily in C/C++, as well as in Python, JavaScript (including ReactJS), Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance