AI Code Evaluation Engineer (Contract)

Turing Enterprises, Inc.; Seattle (WA); Remote; USD 48,000 - 96,000; Part time

Job summary

Turing Enterprises, Inc. is seeking a Software Engineering Evaluator to create advanced datasets for training and benchmarking large language models.

You will curate code examples, provide precise solutions, and correct AI-generated code across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, ensuring quality and reliability. Collaborating with researchers and cross-functional teams, you will design verification mechanisms, build agents to verify code quality, and evaluate software

Qualifications

• 3+ years of software engineering experience.
• Experience building full-stack applications and deploying production software.
• Strong understanding of software architecture, debugging and code quality.

Responsibilities

• Curate code examples and provide precise solutions across multiple languages.
• Evaluate and refine AI-generated code for efficiency, scalability and reliability.
• Collaborate with researchers and cross-functional teams on enterprise-grade AI coding solutions.
• Build agents to verify code quality and identify error patterns.
• Hypothesize software engineering steps and assess model capabilities.
• Design verification mechanisms for automated solution verification.

Skills

Software engineering

Full-stack development

Code review

Technical communication

Tools

Python

JavaScript/ReactJS

C/C++

Java

Rust

Go

Job description

Turing Enterprises, Inc. is seeking a Software Engineering Evaluator to create advanced datasets for training and benchmarking large language models.

You will curate code examples, provide precise solutions, and correct AI-generated code across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go, ensuring quality and reliability. Collaborating with researchers and cross-functional teams, you will design verification mechanisms, build agents to verify code quality, and evaluate software