AI Software Evaluator — Python & Full-Stack

Turing Enterprises, Inc.; Austin (TX); On-site; USD 55,000 - 96,000; Part time

Job summary

Turing Enterprises, Inc. seeks a Software Engineering Evaluator to help create and refine datasets for training large language models, collaborating closely with researchers.

The role centers on Python, with exposure to ReactJS, C/C++, Java, Rust and Go to evaluate AI-generated code for production-grade quality. The contract runs for about 1 month with flexible hours (10–40 hrs/week) and requires candidates based in the United States.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in Python with production-grade software knowledge.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, development, debugging, and code quality.
• Excellent oral and written communication skills for clear evaluation rationales.

Responsibilities

• Create and curate code examples for training datasets.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions.
• Build agents and automated verification tools in Python to verify code quality and detect error patterns.
• Hypothesize on software engineering lifecycle steps and evaluate model capabilities on them.

Skills

Python

JavaScript/React

C/C++/Java

Go/Rust

Code quality

Communication

Job description

Turing Enterprises, Inc. seeks a Software Engineering Evaluator to help create and refine datasets for training large language models, collaborating closely with researchers.

The role centers on Python, with exposure to ReactJS, C/C++, Java, Rust and Go to evaluate AI-generated code for production-grade quality. The contract runs for about 1 month with flexible hours (10–40 hrs/week) and requires candidates based in the United States.