AI Task Designer for Backend Evaluations

Mindrift; Dubai; On-site; AED 126,478,000 - 177,069,000; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities. You will design realistic coding tasks, create self-contained Docker environments, and produce tests that verify outcomes without revealing fixes. Tasks are reviewed by QA and iterated based on feedback, ensuring quality and solvability.

The role emphasizes backend-focused development, Python/pytest fluency, and Docker expertise, with project-based compensation and non-permanent engagement.

Qualifications

• 3+ years of production software development in one backend stack (Python, Go, Node.js, Java, or Rust).
• Python + pytest fluency required; the task harness is pytest-based even if the app is in another language.
• Docker authoring with reproducible environments, pinned dependencies, and non-root user.
• Linux and Bash proficiency for debugging containers (strace, lsof, journalctl).
• AI coding agent experience with Claude Code, Cursor, Roo Code, or similar, on non-trivial work.
• English – B2+ written.

Responsibilities

• Invent a realistic developer scenario (real bug, broken ETL, missing feature).
• Build a reproducible Docker environment with pinned dependencies.
• Write a pytest that verifies outcomes (deterministic, non-flaky).
• Create an instruction.md that reads like a Jira ticket.
• Provide a reference solve.sh proving the task is solvable.
• Calibrate difficulty so state-of-the-art agents solve 20–60% of tasks.
• Iterate based on QA feedback; review other authors’ tasks as QA reviewer.

Skills

Python

pytest

Docker

Linux & Bash

English (B2+)

Backend development

Tools

Docker

pytest

Job description

Mindrift connects specialists with project-based AI opportunities. You will design realistic coding tasks, create self-contained Docker environments, and produce tests that verify outcomes without revealing fixes. Tasks are reviewed by QA and iterated based on feedback, ensuring quality and solvability.

The role emphasizes backend-focused development, Python/pytest fluency, and Docker expertise, with project-based compensation and non-permanent engagement.