Competitive Programming Problem Designer for AI Testing

Mindrift

Town of Texas (WI)

On-site

USD 47,000 - 94,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

You will create competitive programming problems, write correct and incorrect solutions in C++ and Python, and design strong test cases, checkers, and validators to ensure high-quality training data.

Qualifications

  • Strong competitive programming background evidenced by public profile or IOI/ICPC/national-olympiad results.
  • Fluent contest C++ (STL) and comfortable with Python.
  • Ability to explain why a solution is wrong and craft test cases that break it.
  • Experience with testlib or similar checker/validator expertise is a plus.

Responsibilities

  • Write original algorithmic problems with clear statements and constraints.
  • Create correct solutions in C++ and Python; craft realistic wrong solutions for testing.
  • Develop robust test cases, including generators, edge cases, stress tests, and hacking tests.
  • Build checkers/interactors (testlib) for problems with multiple valid answers.
  • Ensure the quality bar: correct solutions pass, wrong ones fail within time limits.

Skills

Competitive programming background
C++ (STL)
Python
English proficiency (C1+)

Tools

Testlib

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

You will create competitive programming problems, write correct and incorrect solutions in C++ and Python, and design strong test cases, checkers, and validators to ensure high-quality training data.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Competitive Programming Problem Designer & Testcase Architect
Competitive Programming Problem Designer & Testcase Architect

Mindrift • New York (NY)

On-site
USD 83,000 - 124,000
Algorithmic Problem Setter & Test-Case Architect
Algorithmic Problem Setter & Test-Case Architect

Mindrift • Michigan

On-site
USD 74,000 - 124,000
Elite CP Problem Setter & Tester
Elite CP Problem Setter & Tester

Dorado • United States

Remote
USD 82,656,000 - 123,984,000
Senior Python Engineer - AI Task Designer & Evaluator
Senior Python Engineer - AI Task Designer & Evaluator

Mindrift • Town of Texas (WI)

On-site
USD 165,312 - 275,520
AI Coding Task Designer & Evaluation Specialist
AI Coding Task Designer & Evaluation Specialist

Mindrift • New York (NY)

On-site
USD 34,440,000 - 48,216,000
Python Engineer - AI Coding Agent Tests (Project)
Python Engineer - AI Coding Agent Tests (Project)

Dorado • United States

Remote
Competitive Programming Expert - Freelance AI Trainer
Competitive Programming Expert - Freelance AI Trainer

Mindrift • New York (NY)

On-site
USD 83,000 - 124,000
Competitive Programming Expert - Freelance AI Trainer
Competitive Programming Expert - Freelance AI Trainer

Mindrift • Town of Texas (WI)

On-site
USD 47,000 - 94,000
Senior Python Engineer for AI Task Evaluation
Senior Python Engineer for AI Task Evaluation

Socket.dev • Alabama

Hybrid
USD 83,000 - 248,000
Senior Python Engineer - AI Task Designer & Evaluator
Senior Python Engineer - AI Task Designer & Evaluator

Socket.dev • Oklahoma

Hybrid
USD 138,000 - 276,000