Senior AI Evaluation Backend Engineer - Remote

Turing; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Turing in San Francisco seeks a backend engineer to design and ship features end to end, including data models, APIs, background workers, and UI when needed.

You will evaluate agents and models, run sandboxed trials, score results, and turn thousands of runs into trusted outcomes, contributing to AI benchmark quality. The role emphasizes ownership and pragmatic tradeoffs in an AI-forward culture.

Qualifications

• 5+ years building and operating production backend systems, with ownership of at least one service from design through on-call.
• Strong Python, experience with Django or a similar framework, PostgreSQL, and a task queue such as Celery.
• Hands-on experience in LLM evaluation, good tradeoff judgment, ownership, and comfort with TypeScript and React when needed.

Responsibilities

• Design and ship features end to end: data model, API, background workers, and the UI when needed.
• Build and improve how agents and models are evaluated: running trials in sandboxed environments, scoring results, and turning thousands of runs into trusted outcomes.
• Improve benchmark task quality checks, including verifiers, rubric-based and LLM-as-a-judge grading, and task fairness.

Skills

Python

Django

PostgreSQL

Celery

TypeScript

React

LLM evaluation

ownership

Tools

Celery

Job description

Turing in San Francisco seeks a backend engineer to design and ship features end to end, including data models, APIs, background workers, and UI when needed.

You will evaluate agents and models, run sandboxed trials, score results, and turn thousands of runs into trusted outcomes, contributing to AI benchmark quality. The role emphasizes ownership and pragmatic tradeoffs in an AI-forward culture.