AI Coding Evaluator — Python Pro (Contractor)

Turing; Dallas (TX); Remote; USD 55,000 - 96,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Competitive hourly rate

Job summary

Turing is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with exposure to JavaScript/ReactJS, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability while collaborating with researchers. The role emphasizes building verification tools and contributing to enterprise-level AI-driven coding

Qualifications

• 3+ years of software engineering experience.
• Strong Python expertise with production-grade software.
• Experience deploying scalable software.
• Excellent oral and written communication for evaluation rationales.

Responsibilities

• Curate code examples and build solutions in Python for AI model training.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with researchers and cross-functional teams on AI-driven coding solutions.
• Build agents and automated verification tools in Python to verify code quality and detect error patterns.
• Assist in architecture design, prototyping, API design, and production implementation.
• Participate in verification mechanisms for software engineering tasks.

Skills

Python

Full‑stack development

Software architecture

Code quality & reviews

Communication

Tools

ReactJS

Go

Rust

Java

C/C++

Job description

Turing is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with exposure to JavaScript/ReactJS, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability while collaborating with researchers. The role emphasizes building verification tools and contributing to enterprise-level AI-driven coding