Contractor AI Code Evaluator - Python & ML (Flexible Hours)

Turing; Austin (TX); Remote; USD 55,000 - 83,000; Full time

Job summary

Turing is seeking a Software Engineering evaluator to help curate datasets for training, benchmarking, and advancing large language models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with additional work in JavaScript (ReactJS), C/C++, Java, Rust, and Go to evaluate and refine AI-generated code.

The engagement is a flexible contractor role in the United States, 10–40 hours per week for 1 month, with potential extensions based on performance.

Qualifications

• Several years of software engineering experience (3 years or more).
• Strong expertise in Python with deep knowledge of frameworks, tooling, and best practices for building production-grade software.
• Experience building full-stack applications and deploying scalable software using modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples and provide precise solutions for AI model training and benchmarking.
• Evaluate AI-generated code for efficiency, scalability, and reliability across Python and other languages.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against performance benchmarks.
• Build agents and automated verification tools in Python to verify code quality and identify error patterns.
• Hypothesize on steps in the software engineering cycle and evaluate model capabilities.

Job description

Turing is seeking a Software Engineering evaluator to help curate datasets for training, benchmarking, and advancing large language models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with additional work in JavaScript (ReactJS), C/C++, Java, Rust, and Go to evaluate and refine AI-generated code.

The engagement is a flexible contractor role in the United States, 10–40 hours per week for 1 month, with potential extensions based on performance.