Python AI Software Engineer - Data & Code Evaluation

Turing; Austin (TX); On-site; USD 83,000 - 124,000; Full time

Job summary

Turing is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will curate code examples and prepare precise solutions primarily in Python, with support across JavaScript, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency and reliability, collaborating with researchers and cross-functional teams. The role focuses on Python-heavy backend data pipelines and ML infrastructure, with a contractor engagement of

Qualifications

• 3+ years of software engineering experience.
• Strong Python expertise with production-grade software.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, design, development, debugging, and code quality.
• Excellent oral and written communication skills for clear evaluation rationales.

Responsibilities

• Curate code examples and build solutions in Python; collaborate across languages (Python, JavaScript, C/C++, Java, Rust, Go).
• Evaluate and refine AI-generated code for efficiency, scalability and reliability.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against benchmarks.
• Build Python-based agents and automated verification tools to assess code quality.
• Hypothesize on software engineering cycle steps and evaluate model capabilities.
• Design verification mechanisms to automatically verify software engineering solutions.

Skills

Python

3+ years experience

Full-stack development

Software architecture

Code quality/review

Communication

ReactJS

Tools

ReactJS

JavaScript

Go

Job description

Turing is seeking a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will curate code examples and prepare precise solutions primarily in Python, with support across JavaScript, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency and reliability, collaborating with researchers and cross-functional teams. The role focuses on Python-heavy backend data pipelines and ML infrastructure, with a contractor engagement of