Remote AI Code Engineer — Benchmark & Validate Models

Turing; United States; Remote; USD 69,000 - 138,000; Part time

Job summary

Turing, based in San Francisco, is seeking a Software Engineering evaluator to create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

You will curate code examples, provide precise solutions, and refine AI-generated code across Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in building full-stack applications and deploying production-grade software.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples for model training and benchmarking.
• Provide precise solutions and corrections in Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code for efficiency and scalability.
• Collaborate with researchers and cross-functional teams on AI-driven coding solutions.
• Build agents to verify code quality and identify error patterns.
• Hypothesize steps in the software engineering cycle and test model capabilities.

Skills

Software engineering

Full-stack development

Architecture & design

Code quality & reviews

Communication skills

Tools

Python

JavaScript/ReactJS

C/C++

Java

Go

Rust

Job description

Turing, based in San Francisco, is seeking a Software Engineering evaluator to create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

You will curate code examples, provide precise solutions, and refine AI-generated code across Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability.