Algorithmic Problem Setter & Test-Case Architect

Mindrift

Michigan

On-site

USD 74,000 - 124,000

Part time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

We are building competitive-programming problems and their automatic graders. You'll create problems, write correct and deliberately-wrong solutions, and design the tough test cases that catch subtly-broken code. Your work is what makes the training signal trustworthy.

Qualifications

  • Strong competitive programming background, shown by a public profile.
  • Fluent contest C++ (STL, complexity); comfortable writing Python.
  • Can explain why a solution is wrong and build an input that breaks it.
  • Strong written English (C1+).

Responsibilities

  • Write original algorithmic problems — clear statement, sound constraints, an intended solution;
  • Write correct solutions in C++ and Python;
  • Write realistic wrong solutions (common mistakes) to test against;
  • Build and harden test cases: generators, edge cases, stress and "hacking" tests;
  • Write checkers/interactors (testlib) for problems with more than one valid answer;
  • Confirm the quality bar: correct solutions pass, wrong ones fail, within time limits.

Skills

Competitive programming
C++ (STL)
Python
Problem setting
English writing

Tools

Testlib

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

We are building competitive-programming problems and their automatic graders. You'll create problems, write correct and deliberately-wrong solutions, and design the tough test cases that catch subtly-broken code. Your work is what makes the training signal trustworthy.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Elite CP Problem Setter & Tester
Elite CP Problem Setter & Tester

Dorado • United States

Remote
USD 82,656,000 - 123,984,000
Competitive Programming Problem Designer for AI Testing
Competitive Programming Problem Designer for AI Testing

Mindrift • Town of Texas (WI)

On-site
USD 47,000 - 94,000
Competitive Programming Problem Designer & Testcase Architect
Competitive Programming Problem Designer & Testcase Architect

Mindrift • New York (NY)

On-site
USD 83,000 - 124,000
Python Engineer - AI Coding Agent Tests (Project)
Python Engineer - AI Coding Agent Tests (Project)

Dorado • United States

Remote
AI Coding Task Designer & Evaluation Specialist
AI Coding Task Designer & Evaluation Specialist

Mindrift • New York (NY)

On-site
USD 34,440,000 - 48,216,000
AI Coding Challenge Architect
AI Coding Challenge Architect

Mindrift • Egypt (PA)

On-site
USD 2,755,000 - 4,822,000
Senior Python Engineer - AI Task Designer & Evaluator
Senior Python Engineer - AI Task Designer & Evaluator

Socket.dev • Oklahoma

Hybrid
USD 138,000 - 276,000
AI Coding Challenge Designer for Real-World Tasks
AI Coding Challenge Designer for Real-World Tasks

Socket.dev • Lebanon

On-site
USD 29,000 - 48,000
Mathematics & Python Problem Designer (Part-Time)
Mathematics & Python Problem Designer (Part-Time)

Mindrift • Iowa (LA)

On-site
USD 63,000 - 105,000
Senior Python Engineer for AI Task Evaluation
Senior Python Engineer for AI Task Evaluation

Socket.dev • Alabama

Hybrid
USD 83,000 - 248,000