Senior Software Engineer - AI Coding Evaluator

Turing; Austin (TX); On-site; USD 14,000 - 55,000; Part time

Job summary

Turing, based in San Francisco, CA, is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. The role focuses on Python across backend services, data pipelines, ML infrastructure, with additional work in JavaScript and other languages.

You will curate code examples, provide precise solutions, evaluate AI-generated code for efficiency and scalability, and collaborate with researchers and cross-functional teams.

Qualifications

• 3+ years of software engineering experience.
• Strong Python expertise with production-grade software practices.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, development, debugging, and code quality.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples and build solutions primarily in Python.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions.
• Build agents and automated verification tools in Python.
• Hypothesize on steps in the software engineering cycle and evaluate model capabilities.

Skills

Python

Full-stack

Software architecture

Code quality

Communication

Tools

ReactJS

C/C++

Java

Go

Job description

Turing, based in San Francisco, CA, is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. The role focuses on Python across backend services, data pipelines, ML infrastructure, with additional work in JavaScript and other languages.

You will curate code examples, provide precise solutions, evaluate AI-generated code for efficiency and scalability, and collaborate with researchers and cross-functional teams.