AI Task Designer & Evaluator

Tanqeeb; Kuwait City; Remote; KWD 17,000 - 21,000; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

You’ll build realistic developer environments, design tasks from intermediate states, and write tests to verify agent solutions. This is a project-based role, not permanent employment, with flexible scheduling and language requirements.

Qualifications

• 5+ years in software development
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• Experience writing tests (functional, integration)
• English proficiency - B2+

Responsibilities

• Create challenging tasks and evaluation criteria within realistic simulated environments
• Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones
• Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust
• Guide and evaluate the AI coding agent development process and outputs

Skills

Python

JavaScript/TypeScript

Docker

PostgreSQL

Kafka

Redis

Testing (functional/integration)

English (B2+)

Tools

Docker

PostgreSQL

Kafka

Redis

FastAPI

React (UI)

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

You’ll build realistic developer environments, design tasks from intermediate states, and write tests to verify agent solutions. This is a project-based role, not permanent employment, with flexible scheduling and language requirements.