Remote AI Software Evaluator (Python/ML) — Contractor

Turing

Los Angeles (CA)

Remote

USD 55,000 - 96,000

Part time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing in San Francisco seeks a Software Engineering Evaluator to create datasets for training and benchmarking large language models, collaborating with researchers. You will curate code examples and provide precise solutions across Python, ReactJS, C/C++, Java, Rust, and Go, focusing on production‑grade software.

You will evaluate AI‑generated code for efficiency, collaborate with researchers and cross‑functional teams, and build verification tools in Python.

Qualifications

Several years of software engineering experience (3 years or more).
Strong expertise in Python with deep knowledge of frameworks, tooling, and best practices for building production‑grade software.
Experience building full‑stack applications and deploying scalable software using modern languages and tools.
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

Curate code examples, provide precise solutions, and correct code for AI datasets, focusing on Python and other languages.
Evaluate and refine AI‑generated code for efficiency, scalability, and reliability.
Collaborate with researchers and cross‑functional teams to enhance AI‑driven coding solutions.
Build agents and automated verification tools in Python to verify code quality and identify error patterns.
Design verification mechanisms to automatically verify solutions to software engineering tasks.