Remote AI Software Evaluator – Full-Stack Engineer (Python)

Turing; Chicago (IL); Remote; USD 83,000 - 165,000; Full time

Job summary

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models.

You’ll curate Python code examples, provide precise solutions, and correct code while collaborating with researchers across backend services and ML infrastructure. The role emphasizes evaluating AI-generated code for efficiency and scalability and building automated verification tools.

Qualifications

• Several years of software engineering experience (3+ years).
• Strong Python expertise with production-grade software practices.
• Experience building full-stack applications and deploying scalable software.
• Excellent oral and written communication for evaluation rationales.

Responsibilities

• Curate code examples and build solutions primarily in Python.
• Evaluate and refine AI-generated code for efficiency and scalability.
• Collaborate with researchers and cross-functional teams on AI-driven coding solutions.
• Develop verification tools in Python to check code quality.

Skills

Python

Full-stack development

Code review

Software engineering

Tools

ReactJS

C/C++

Java

Rust

Go

Job description

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models.

You’ll curate Python code examples, provide precise solutions, and correct code while collaborating with researchers across backend services and ML infrastructure. The role emphasizes evaluating AI-generated code for efficiency and scalability and building automated verification tools.