Rust AI Engineer - Data & Model Evaluation (Contract)

turing; California (MO); Hybrid; USD 71,000 - 143,000; Full time

Job summary

Turing, based in San Francisco, CA, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions, primarily in Rust, alongside Python, JavaScript (ReactJS), C/C++, Java, and Go, while evaluating and refining AI-generated code for efficiency and reliability.

Collaborating with researchers and cross-functional teams, you will build agents to verify code quality and identify

Qualifications

• Several years of software engineering experience (3 years or more).
• Strong expertise in building full-stack applications and deploying scalable, production-grade software.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples and build solutions primarily in Rust, and in Python, JavaScript (ReactJS), C/C++, Java, and Go.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
• Build agents that can verify the quality of the code and identify error patterns.
• Hypothesize steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them.
• Design verification mechanisms that can automatically verify a solution to a software engineering task.

Skills

Software engineering

Full-stack development

Code quality

Communication skills

Tools

Rust

Python

JavaScript

Go

C/C++

Java

Job description

Turing, based in San Francisco, CA, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions, primarily in Rust, alongside Python, JavaScript (ReactJS), C/C++, Java, and Go, while evaluating and refining AI-generated code for efficiency and reliability.

Collaborating with researchers and cross-functional teams, you will build agents to verify code quality and identify