Senior AI Evaluation Infra Engineer (Remote)

Turing; United States; Remote; USD 170,000 - 200,000; Full time

Benefits offered by this job

Equity

Job summary

Turing is hiring a Senior Software Engineer for AI Evaluation Infrastructure in the United States. You will own features across the stack, from data models and APIs to background jobs and UI elements, enabling scalable evaluation of coding agents and language models.

This role requires shipping high-quality, tested code independently, making tradeoffs, and ensuring safe, maintainable systems as adoption grows.

Qualifications

• Five or more years building and operating production backend systems.
• Bachelor’s degree or higher in Software Engineering, Computer Science, or a related field.
• Strong Python and Django experience, plus PostgreSQL and a task queue (e.g., Celery).
• Hands-on experience with LLM evaluation and benchmark tasks.

Responsibilities

• Design and ship end-to-end features: data model, API, background workers, and UI when needed.
• Build and improve evaluation of agents and models, including trials and scoring.
• Improve benchmark task quality checks with verifiers and rubric-based grading.
• Integrate new models/agents/benchmarks with generalizable approaches.
• Maintain speed and reliability as usage grows with efficient queries and migrations.
• Review pull requests to uphold engineering guidelines and code quality.

Skills

Backend systems

Python

Django

PostgreSQL

LLM evaluation

Education

Bachelor’s degree or higher in Software Engineering/CS

Tools

Harbor

Terminal-Bench

SWE-bench

Inspect

Job description

Turing is hiring a Senior Software Engineer for AI Evaluation Infrastructure in the United States. You will own features across the stack, from data models and APIs to background jobs and UI elements, enabling scalable evaluation of coding agents and language models.

This role requires shipping high-quality, tested code independently, making tradeoffs, and ensuring safe, maintainable systems as adoption grows.