Remote AI Software Evaluator — Contractor

Turing Enterprises, Inc.; San Francisco (CA); Remote; USD 69,000 - 96,000; Part time

Job summary

Turing is seeking a Software Engineering evaluator in a contractor role from the United States. You will create, curate, and critique code examples across languages including Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS) to improve AI-driven coding solutions.

You will work with researchers and engineers to raise reliability and performance of systems-level code. You will be responsible for verifying AI-generated code, building verification mechanisms, and collaborating with

Qualifications

• This role requires several years of software engineering experience (3 years or more).
• Strong expertise in systems programming, infrastructure, or backend development with Python, C/C++, Rust, and Go.
• Experience building production-grade software using modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality/review.

Responsibilities

• Work on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS).
• Evaluate and refine AI-generated code with an emphasis on systems-level correctness, performance, and reliability.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
• Build agents that can verify the quality of systems-level and infrastructure code and identify error patterns.
• Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them.
• Design verification mechanisms that can automatically verify a solution to a software engineering task.

Skills

Systems programming

Backend development

Python

C/C++

Rust

Go

JavaScript

ReactJS

Code review

Communication skills

Tools

Docker

CI/CD

Unit testing

Job description

Turing is seeking a Software Engineering evaluator in a contractor role from the United States. You will create, curate, and critique code examples across languages including Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS) to improve AI-driven coding solutions.

You will work with researchers and engineers to raise reliability and performance of systems-level code. You will be responsible for verifying AI-generated code, building verification mechanisms, and collaborating with