Senior Backend Engineer for AI Benchmark Platform (Equity)

Remote Genie

San Francisco (CA)

On-site

USD 140,000 - 240,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing, headquartered in San Francisco, is seeking an experienced Software Engineer to own features across the stack—from data model and API to background jobs and UI. You will advance evaluation pipelines for coding agents and language models, ensure fast, reliable systems, and collaborate across backend and frontend as needed.

You will bring 5+ years building production backend systems, strong Python/Django, PostgreSQL, Celery, and hands-on LLM benchmarking experience.

Qualifications

  • 5+ years building and operating production backend systems.
  • Bachelor’s degree or higher in Software Engineering, Computer Science, or a related field.
  • Strong Python and experience with Django (or a similar framework), PostgreSQL, and a task queue such as Celery.
  • Hands-on experience in LLM evaluation and benchmarking.
  • Able to identify ambiguous instructions, weak verifiers, and bias in judging.
  • Ability to keep designs simple, justify tradeoffs, and own from design to deployment.
  • Familiarity with a TypeScript/React frontend is helpful, not mandatory.
  • Clear, well-structured writing in design notes and PR descriptions.

Responsibilities

  • Design and ship features end to end: data model, API, background workers, and UI if needed.
  • Build and improve how agents and models are evaluated and scored.
  • Improve benchmark task quality checks with verifiers and rubric-based grading.
  • Integrate new models, agents, and benchmarks with generalizable patterns.
  • Keep system fast and reliable as usage grows, including migrations and concurrency.
  • Review teammates’ PRs to ensure coding guidelines and consistency.

Skills

Backend systems
Python
Django
PostgreSQL
Celery
LLM evaluation
TypeScript
React
Code review
System design

Education

Bachelor's degree in Software Engineering or Computer Science

Tools

Harbor
Terminal-Bench
SWE-bench
Inspect

Job description

Turing, headquartered in San Francisco, is seeking an experienced Software Engineer to own features across the stack—from data model and API to background jobs and UI. You will advance evaluation pipelines for coding agents and language models, ensure fast, reliable systems, and collaborate across backend and frontend as needed.

You will bring 5+ years building production backend systems, strong Python/Django, PostgreSQL, Celery, and hands-on LLM benchmarking experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer (Python) for AI Benchmarking
Senior Backend Engineer (Python) for AI Benchmarking

Turing • United States

Remote
USD 83,000 - 131,000
Senior Software Engineer, AI Benchmark Platform
Senior Software Engineer, AI Benchmark Platform

Turing • United States

Remote
USD 140,000 - 210,000
Senior AI Evaluation Infra Engineer - Equity
Senior AI Evaluation Infra Engineer - Equity

Fdetimes • San Francisco (CA)

On-site
USD 170,000 - 200,000
Remote Senior Software Engineer: LLM Benchmarking & Infra
Remote Senior Software Engineer: LLM Benchmarking & Infra

remote work • United States

Remote
USD 120,000 - 180,000
Remote Senior AI Evaluation Infrastructure Engineer
Remote Senior AI Evaluation Infrastructure Engineer

turing • San Francisco (CA)

Remote
USD 170,000 - 200,000
Equity
Senior AI Evaluation Backend Engineer - Remote
Senior AI Evaluation Backend Engineer - Remote

Turing • United States

Remote
USD 150,000 - 210,000
Senior Software Engineer, AI Evaluation Infrastructure (Fully Remote)
Senior Software Engineer, AI Evaluation Infrastructure (Fully Remote)

Turing • United States

Remote
USD 150,000 - 210,000
Staff Engineer, LLM Benchmark Platform
Staff Engineer, LLM Benchmark Platform

Vals AI, Inc. • San Francisco (CA)

On-site
USD 140,000 - 220,000
Relocation support
Health insurance
Lunch/dinner provided
+3
Senior Full-Stack Engineer for AI Benchmarking (Equity)
Senior Full-Stack Engineer for AI Benchmarking (Equity)

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 120,000 - 150,000
Competitive compensation including equity
Senior AI/ML Engineer — Benchmarking & Analytics Lead
Senior AI/ML Engineer — Benchmarking & Analytics Lead

Fdetimes • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
On-site office
Competitive salary