Senior Backend Engineer (Python) for AI Benchmarking

Turing; United States; Remote; USD 83,000 - 131,000; Part time

Job summary

Turing, based in San Francisco, seeks a Software Engineering evaluator to create datasets for training and benchmarking AI models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with exposure to JavaScript, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability and reliability, collaborating with researchers and cross-functional teams.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in Python with production-grade software knowledge.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, design, development, debugging, and code quality/review.
• Excellent oral and written communication skills for clear evaluation rationales.

Responsibilities

• Curate and evaluate Python-based datasets for AI model training and benchmarking.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with researchers and cross-functional teams on enterprise AI solutions.
• Build Python-based agents and automated verification tools for code quality checks.
• Hypothesize on software engineering cycle steps and evaluate model capabilities on them.
• Design verification mechanisms to automatically verify software engineering solutions.

Skills

Python

JavaScript

Java

C++

Rust

Job description

Turing, based in San Francisco, seeks a Software Engineering evaluator to create datasets for training and benchmarking AI models. You will focus on Python across backend services, data pipelines, and ML infrastructure, with exposure to JavaScript, C/C++, Java, Rust, and Go.

You will evaluate AI-generated code for efficiency, scalability and reliability, collaborating with researchers and cross-functional teams.