Software Engineer

RemoteWork

United States

Remote

USD 120,000 - 180,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Turing builds infrastructure for evaluating coding agents and language models. You will own features across the stack—from data models to the UI—shipping production-grade backend and frontend work for benchmark tasks and agent evaluations.

You will design end-to-end features, develop evaluation workflows, and ensure reliability as usage grows. Strong Python/Django and PostgreSQL are essential, with TS/React for user-visible changes.

Qualifications

  • 5+ years building and operating production backend systems with ownership of at least one service.
  • Bachelor's degree or higher in Software Engineering, Computer Science, or a related field.
  • Strong Python and Django (or similar), PostgreSQL, and a task queue such as Celery.
  • Hands-on experience in LLM evaluation and understanding benchmark task construction.
  • Comfort with TypeScript and React frontend for user-visible changes.
  • Nice to have experience with Docker, Kubernetes, or cloud sandboxes and LLM-as-a-judge tooling.

Responsibilities

  • Design and ship end-to-end features including data models, APIs, background jobs, and UI elements when needed.
  • Develop and improve agent and model evaluation workflows in sandboxed environments.
  • Quality-check benchmark tasks using verifiers and rubric-based or LLM-based grading.
  • Integrate new models, agents, and benchmarks with generalizable approaches.
  • Maintain system performance and reliability as usage grows.
  • Review teammates’ pull requests to uphold engineering guidelines.

Skills

Python
Django
PostgreSQL
Celery
LLM evaluation

Education

Bachelor's degree or higher in Software Engineering/CS

Tools

Docker
Kubernetes
Cloud sandboxes
LLM-as-a-judge tooling

Job description

About the role

Turing builds infrastructure for evaluating coding agents and language models. You will own features across the stack from the data model to the UI, shipping production-grade backend and frontend work for benchmark tasks and agent evaluations.

What you'll do
  • Design and ship end-to-end features including data models, APIs, background jobs, and UI elements when needed
  • Develop and improve agent and model evaluation workflows in sandboxed environments
  • Quality-check benchmark tasks using verifiers and rubric-based or LLM-based grading
  • Integrate new models, agents, and benchmarks with generalizable approaches
  • Maintain system performance and reliability as usage grows
  • Review teammates’ pull requests to uphold engineering guidelines
What they're looking for
  • 5+ years building and operating production backend systems with ownership of at least one service
  • Bachelor's degree or higher in Software Engineering, Computer Science, or a related field
  • Strong Python and Django (or similar), PostgreSQL, and a task queue such as Celery
  • Hands-on experience in LLM evaluation and understanding benchmark task construction
  • Comfort with TypeScript and React frontend for user-visible changes
  • Nice to have experience with Docker, Kubernetes, or cloud sandboxes and LLM-as-a-judge tooling
For applicants in Nigeria
  • The listing states Global - Remote and eligibility worldwide; Nigeria is included in worldwide eligibility
  • The listing does not specify a timezone requirement; confirm before interviewing
  • The listing does not specify contractor vs employee; confirm during interview process
  • Compensation is listed as a salary range in USD; confirm currency details during hiring
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Software Engineer: LLM Benchmarking & Infra
Remote Senior Software Engineer: LLM Benchmarking & Infra

remote work • United States

Remote
USD 120,000 - 180,000
Senior Software Engineer, AI Evaluation Infrastructure (Fully Remote)
Senior Software Engineer, AI Evaluation Infrastructure (Fully Remote)

Turing • United States

Remote
USD 150,000 - 210,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

remote work • United States

Remote
USD 83,000 - 138,000
Senior Python Engineer – LLM Evaluation (US-based)
Senior Python Engineer – LLM Evaluation (US-based)

Turing • United States

Remote
USD 69,000 - 96,000
Senior Software Engineer, AI Evaluation Infrastructure
Senior Software Engineer, AI Evaluation Infrastructure

Turing • United States

Remote
USD 170,000 - 200,000
Equity
Senior Software Engineer – LLM Evaluation (US-based)
Senior Software Engineer – LLM Evaluation (US-based)

Turing • United States

Remote
USD 55,000 - 110,000
Senior Software Engineer, AI Evaluation Infrastructure
Senior Software Engineer, AI Evaluation Infrastructure

turing • San Francisco (CA)

Remote
USD 170,000 - 200,000
Equity
Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)
Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)

Perplexity • New York (NY)

On-site
USD 150,000 - 190,000
Senior Software Engineer – LLM Evaluation (Fully Remote)
Senior Software Engineer – LLM Evaluation (Fully Remote)

Partner Company • United States

Remote
USD 83,000 - 165,000
Remote-friendly
Flexible hours
Contractor-friendly
Senior Software Engineer - 35501
Senior Software Engineer - 35501

Turing • New York (NY)

Remote
USD 68,880 - 206,640