Senior AI Software Evaluator - Python & Full-Stack

Turing; City Of London; On-site; GBP 67,000 - 96,000; Full time

Job summary

Turing (based in San Francisco, CA) seeks a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code, provide precise solutions, and correct errors across Python-focused backend services, data pipelines, and ML infrastructure, with exposure to JavaScript, C/C++, Java, Rust and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability while collaborating with researchers to advance

Qualifications

• 3+ years of software engineering experience.
• Strong Python expertise with production-grade software experience.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, design, debugging, and code quality.

Responsibilities

• Curate code examples and build solutions primarily in Python.
• Evaluate and refine AI-generated code for efficiency and scalability.
• Collaborate with cross-functional teams on AI-driven coding solutions.
• Build Python-based agents and automated verification tools.
• Hypothesize steps in the software engineering cycle and evaluate model capabilities.
• Design verification mechanisms to automatically verify software tasks.

Skills

Python

Full-stack development

Software architecture

Communication skills

ReactJS

Job description

Turing (based in San Francisco, CA) seeks a Software Engineering Evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code, provide precise solutions, and correct errors across Python-focused backend services, data pipelines, and ML infrastructure, with exposure to JavaScript, C/C++, Java, Rust and Go.

You will evaluate AI-generated code for efficiency, scalability, and reliability while collaborating with researchers to advance