Senior Python Engineer - AI Data & Model

Turing; United States; Remote; USD 69,000 - 96,000; Full time

Job summary

Turing, based in San Francisco, seeks a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and refine AI-generated code across Python and other languages, collaborating with researchers and engineering teams.

You will build verification tools in Python, support architecture design, and evaluate model capabilities through automated tasks and experiments in enterprise AI coding solutions.

Qualifications

• This role requires 3+ years of software engineering experience.
• Strong Python expertise with production-grade frameworks and tooling.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of architecture, design, debugging, and code quality.
• Excellent oral and written communication skills for evaluation rationales.

Responsibilities

• Create cutting-edge datasets for training, benchmarking, and advancing large language models.
• Evaluate and refine AI-generated code for efficiency and reliability.
• Collaborate with researchers and cross-functional teams to improve enterprise AI coding solutions.
• Build agents and automated verification tools in Python to verify code quality and detect error patterns.
• Hypothesize steps in the software engineering cycle and assess model capabilities accordingly.
• Design verification mechanisms to automatically verify solutions to software tasks.

Skills

Python

JavaScript

Java

C/C++

Rust

Go

Full-stack dev

Software architecture

Code quality

Communication skills

Tools

ReactJS

Job description

Turing, based in San Francisco, seeks a Software Engineering evaluator to create datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and refine AI-generated code across Python and other languages, collaborating with researchers and engineering teams.

You will build verification tools in Python, support architecture design, and evaluate model capabilities through automated tasks and experiments in enterprise AI coding solutions.