Senior AI Evaluation Infra Engineer - Equity

Fdetimes; San Francisco (CA); On-site; USD 170,000 - 200,000; Full time

Job summary

Turing is hiring a Senior Software Engineer for AI Evaluation Infrastructure in San Francisco. You will own features across the stack—from data models and APIs to background jobs and UI elements—delivering scalable solutions for evaluating coding agents and language models.

Ideal candidates have 5+ years in production backend systems, strong Python/Django experience, PostgreSQL, and familiarity with LLM evaluation harnesses. Equity accompanies the compensation package.

Qualifications

• 5+ years building and operating production backend systems with ownership of at least one service.
• Bachelor’s degree or higher in Software Engineering, Computer Science, or related field.
• Strong Python and Django, PostgreSQL, and a task queue such as Celery; practical system ownership.

Responsibilities

• Design and ship features end to end: data model, API, background workers, and UI where needed.
• Improve evaluation for agents and models; run trials in sandboxed environments and aggregate results.
• Quality-check benchmark tasks with verifiers, rubric-based judgments, or LLMS as judges.

Skills

Backend engineering

Python

Django

PostgreSQL

Celery

LLM evaluation

Code ownership

On-call experience

Education

Bachelor's degree in CS or related field

Tools

Harbor

Terminal-Bench

SWE-bench

Inspect

Job description

Turing is hiring a Senior Software Engineer for AI Evaluation Infrastructure in San Francisco. You will own features across the stack—from data models and APIs to background jobs and UI elements—delivering scalable solutions for evaluating coding agents and language models.

Ideal candidates have 5+ years in production backend systems, strong Python/Django experience, PostgreSQL, and familiarity with LLM evaluation harnesses. Equity accompanies the compensation package.