Senior Software Engineer, AI Benchmark Platform

Turing; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Turing in San Francisco builds the infrastructure that frontier AI labs rely on to evaluate coding agents and language models, including benchmark datasets, trials, and automated quality checks. You would own features across the stack—from data models and background jobs to the screens our users work in every day.

This is a role for an experienced engineer who works independently, makes sound tradeoffs, and turns a loosely defined request into something shipped, tested, and safe to leave alone.

Qualifications

• 5+ years building and operating production backend systems with ownership of at least one service from design through on-call.
• Bachelor’s degree or higher in Software Engineering, Computer Science, or a related field.
• Strong Python and experience with Django (or similar framework), PostgreSQL, and a task queue such as Celery. Real system ownership matters more than framework name.

Responsibilities

• Design and ship features end to end across data model, API, background workers, and UI when needed.
• Improve how agents and models are evaluated with sandboxed trials and scoring results.
• Quality-check benchmark tasks with verifiers, rubric-based grading, and fair scoring.
• Integrate new models, agents, and benchmarks in a generalized way without per-item special cases.
• Keep the system fast and reliable as usage grows with efficient queries and safe migrations.
• Review teammates’ pull requests to maintain coding standards and consistency.

Skills

Python

Django

PostgreSQL

Celery

LLM evaluation

System design

Education

Bachelor’s degree in Software Engineering or Computer Science

Tools

Django

PostgreSQL

Celery

Job description

Turing in San Francisco builds the infrastructure that frontier AI labs rely on to evaluate coding agents and language models, including benchmark datasets, trials, and automated quality checks. You would own features across the stack—from data models and background jobs to the screens our users work in every day.

This is a role for an experienced engineer who works independently, makes sound tradeoffs, and turns a loosely defined request into something shipped, tested, and safe to leave alone.