Backend Engineer: AI Task Author & QA Specialist

Dorado

United States

Remote

USD 39,000 - 48,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mindrift is seeking a skilled backend-focused engineer to design challenging AI coding tasks. You will craft self-contained Docker environments containing broken code, accompanying tests, and clear instructions.

Your outputs include a reference solution and a deterministic PyTest suite to validate solutions while avoiding leakage of fixes. The role emphasizes realistic, non-toy problems that test AI agents’ debugging ability, with project-based, contract-style engagement and competitive hourly

Qualifications

  • 3+ years of production software development in a backend stack (Python, Go, Node.js, Java, or Rust).
  • Fluent Python + pytest skills and test authoring.
  • Experience authoring reproducible Docker environments with pinned dependencies.

Responsibilities

  • Design real-world developer tasks as self-contained Docker environments.
  • Create reproducible Docker setups with pinned dependencies.
  • Write deterministic Pytest tests that verify outcomes without exposing fixes.
  • Draft an instruction.md that mirrors a Jira ticket.

Skills

Backend development
Python
pytest
Docker
Linux/Bash
English (B2+)
AI coding agent experience

Tools

Dockerfiles
pytest
container tooling

Job description

Mindrift is seeking a skilled backend-focused engineer to design challenging AI coding tasks. You will craft self-contained Docker environments containing broken code, accompanying tests, and clear instructions.

Your outputs include a reference solution and a deterministic PyTest suite to validate solutions while avoiding leakage of fixes. The role emphasizes realistic, non-toy problems that test AI agents’ debugging ability, with project-based, contract-style engagement and competitive hourly

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Contract AI Evaluation Engineer (Python/Docker)
Contract AI Evaluation Engineer (Python/Docker)

Dorado • United States

Remote
USD 34,440,000 - 48,216,000
Senior Python Engineer — AI Task Designer & Evaluator
Senior Python Engineer — AI Task Designer & Evaluator

Dorado • United States

Remote
Python Engineer - AI Coding Agent Tests (Project)
Python Engineer - AI Coding Agent Tests (Project)

Dorado • United States

Remote
AI Coding Evaluator & Testing Architect (Python)
AI Coding Evaluator & Testing Architect (Python)

Mindrift • United States

On-site
USD 55,000 - 69,000
AI Coding Challenge Architect
AI Coding Challenge Architect

Mindrift • Egypt (PA)

On-site
USD 2,755,000 - 4,822,000
Senior AI Evaluation Engineer – Agent Testing & Tasks
Senior AI Evaluation Engineer – Agent Testing & Tasks

Dorado • United States

Remote
Software Engineer - AI Agent Evaluation
Software Engineer - AI Agent Evaluation

aitrainer • New York (NY), Northern (KY)

Hybrid
USD 57,000 - 81,000
AI Evaluation Engineer — Flexible Hours, High-Impact Testing
AI Evaluation Engineer — Flexible Hours, High-Impact Testing

Mindrift • United States

On-site
USD 41,000 - 69,000
Mechanical Engineer for AI Systems Testing (Part-Time)
Mechanical Engineer for AI Systems Testing (Part-Time)

Mindrift • Dallas (TX)

On-site
USD 45,000 - 76,000
Algorithmic Problem Setter & Test-Case Architect
Algorithmic Problem Setter & Test-Case Architect

Mindrift • Michigan

On-site
USD 74,000 - 124,000