Freelance AI Task Architect & Backend Engineer

Dorado

Canada

Hybrid

CAD 34,000 - 48,000

Full time

4 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mindrift seeks a skilled backend-focused developer to design real-world AI coding tasks. You will create Dockerized, self-contained challenges with broken code, tests, and instructions. Your work includes a reference solution and a deterministic pytest, ensuring tasks are solvable and reproducible for AI agents.

Collaboration spans QA reviewers and ongoing task iteration. The role emphasizes Python, pytest, Docker, Linux/Bash proficiency, and English at B2+ level, with project-based engagement

Qualifications

  • 3+ years of production software development in one backend stack (Python, Go, Node.js, Java, or Rust).
  • Python + pytest fluency required.
  • Docker authoring with reproducible environments and non-root users.
  • Linux & Bash proficiency for container debugging.

Responsibilities

  • Invent realistic developer scenarios with real bugs or missing features.
  • Build reproducible Docker environments with pinned dependencies.
  • Write deterministic, non-flaky pytest tests that verify outcomes.
  • Create instruction.md that reads like a Jira ticket.
  • Produce a reference solve.sh proving task solvable.
  • Calibrate difficulty so AI agents solve 20–60% of tasks.
  • Iterate based on expert QA feedback.

Skills

Python
pytest
Bash
AI coding agent experience
English (B2+)
Backend development

Tools

Docker
Dockerfiles

Job description

Mindrift seeks a skilled backend-focused developer to design real-world AI coding tasks. You will create Dockerized, self-contained challenges with broken code, tests, and instructions. Your work includes a reference solution and a deterministic pytest, ensuring tasks are solvable and reproducible for AI agents.

Collaboration spans QA reviewers and ongoing task iteration. The role emphasizes Python, pytest, Docker, Linux/Bash proficiency, and English at B2+ level, with project-based engagement

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineering Evaluation Specialist
Software Engineering Evaluation Specialist

Socket.dev • Quebec

On-site
CAD 48,000 - 67,000
Freelance Software Engineer - AI Coding Agent Evaluation Mindrift · Remote Pay not listed →
Freelance Software Engineer - AI Coding Agent Evaluation Mindrift · Remote Pay not listed →

Dorado • Canada

Hybrid
CAD 34,000 - 48,000
Algorithmic Problem Setter & Test-Case Architect
Algorithmic Problem Setter & Test-Case Architect

Socket.dev • Manitoba

Hybrid
CAD 57,000 - 172,000
Freelance Machine Learning Engineer (Python)
Freelance Machine Learning Engineer (Python)

Mindrift • Canada

Remote
Competitive hourly rates
Participation in advanced AI projects
Flexible working hours
Freelance Data Science Expert (Python & SQL) / AI Trainer
Freelance Data Science Expert (Python & SQL) / AI Trainer

Mindrift • Canada

Remote
Freelance Software Developer (Ruby) - AI Trainer
Freelance Software Developer (Ruby) - AI Trainer

Mindrift • Canada

Remote
Competitive pay rates up to $48/hour
Flexibility to work around other commitments
Experience on advanced AI projects
Freelance Machine Learning Engineer (Python)
Freelance Machine Learning Engineer (Python)

Mindrift • Canada

Remote
Competitive pay up to $55/hour
Flexible remote work schedules
Gain experience on advanced AI projects
Freelance Agent Evaluation Analyst
Freelance Agent Evaluation Analyst

Mindrift • Canada

Remote
Competitive pay up to $45 per hour
Flexible remote work
Experience in advanced AI projects
Freelance Economics Expert - AI Trainer
Freelance Economics Expert - AI Trainer

Mindrift • Canada

Remote
Competitive pay rates
Flexible, remote work
Freelance AI Trainer - Civil Engineering & Python
Freelance AI Trainer - Civil Engineering & Python

Mindrift • Canada

Remote
Earn up to $33/hour
Flexible work hours
Remote work opportunity