Java Software Engineer for AI Code Evaluation (Contract)

Turing; Chicago (IL); On-site; USD 28,000 - 55,000; Part time

Job summary

Turing, a leading AI research accelerator, seeks a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct code primarily in Java, with Python, JavaScript/ReactJS, C/C++, Rust, and Go as support.

You will evaluate AI-generated code for efficiency, scalability, and reliability, and work with researchers and engineers to enhance enterprise-level AI-driven coding

Qualifications

• Several years of software engineering experience (3+ years).
• Strong experience building full-stack applications and deploying production-grade software.
• Deep understanding of software architecture, design, development, debugging, and code quality.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples and solutions for training datasets.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to improve AI-driven coding solutions.
• Build agents that verify quality and identify error patterns in code.
• Hypothesize steps in the software engineering cycle and evaluate model capabilities.
• Design verification mechanisms for automated validation of solutions.

Skills

Full-stack development

Software architecture

Code quality & review

Clear communication

Tools

Java

Python

JavaScript/ReactJS

C/C++

Rust

Go

Job description

Turing, a leading AI research accelerator, seeks a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct code primarily in Java, with Python, JavaScript/ReactJS, C/C++, Rust, and Go as support.

You will evaluate AI-generated code for efficiency, scalability, and reliability, and work with researchers and engineers to enhance enterprise-level AI-driven coding