AI Code Evaluation Engineer – Frontend & Backend

HumanitApp; San Francisco (CA); On-site; USD 83,000 - 138,000; Part time

Job summary

Turing, based in San Francisco, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will work with researchers to curate code examples, provide precise solutions, and fix issues across the full stack.

Evaluate AI-generated code for backend and frontend, design verification mechanisms, and partner with teams to improve AI-driven coding solutions.

Qualifications

• Several years of software engineering experience (3+ years).
• Experience deploying scalable, production‑grade software.
• Excellent written and verbal communication for clear evaluation rationales.

Responsibilities

• Evaluate AI-generated code across backend and frontend contexts.
• Collaborate with researchers to curate datasets and provide precise solutions.
• Identify errors and propose corrections across the full-stack.

Skills

Software engineering

Code quality

Backend/frontend

Communication

Job description

Turing, based in San Francisco, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will work with researchers to curate code examples, provide precise solutions, and fix issues across the full stack.

Evaluate AI-generated code for backend and frontend, design verification mechanisms, and partner with teams to improve AI-driven coding solutions.