Contract AI Software Engineer: Code Curation & Evaluation

Turing

Chicago (IL)

Remote

USD 55,000 - 110,000

Part time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours

Partial PST overlap

Job summary

Turing seeks a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and refine AI-generated code across Python, JavaScript, C/C++, Java, Rust, and Go, collaborating with researchers and cross-functional teams.

Responsibilities include evaluating code efficiency, scalability, and reliability, building verification agents, and designing production-ready software evaluation

Qualifications

3+ years of software engineering experience.
Deep understanding of building full-stack applications and production-grade software.
Strong grasp of software architecture, design, development, debugging, and review.

Responsibilities

Curate code examples and build solutions across languages (Python, JavaScript, C/C++, Java, Rust, Go).
Evaluate and refine AI-generated code for efficiency and scalability.
Collaborate with cross-functional teams to enhance AI-driven coding solutions against benchmarks.
Build agents to verify code quality and identify error patterns.
Hypothesize stages of the software engineering cycle and evaluate model capabilities on them.
Design verification mechanisms to automatically verify solutions.

Skills

Full-stack development

Software architecture

Code quality & reviews

Clear communication

Job description

Responsibilities include evaluating code efficiency, scalability, and reliability, building verification agents, and designing production-ready software evaluation

Get your free, confidential resume review.

or drag and drop your file here.