Contract AI Evaluation Engineer — Task Design & Testing

Explore more jobs; Kuwait City; On-site; KWD 18,000 - 25,000; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

You’ll build realistic developer environments, design tasks, and write tests that accept diverse correct solutions while excluding incorrect ones. Strong English (B2+) and 5+ years in software are required.

Qualifications

• 5+ years in software development.
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing tests (functional, integration).
• English proficiency - B2+.

Responsibilities

• Build a dataset to evaluate AI coding agents and develop tasks.
• Design evaluation criteria and ensure task solvability for AI agents.
• Write tests that accept all valid approaches and reject incorrect ones.
• Iterate on tasks and tests based on QA feedback to ensure fair, robust evaluation.

Skills

Software development experience

English proficiency B2+

Test writing experience

AI evaluation understanding

Tools

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

PostgreSQL

Kafka

Redis

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

You’ll build realistic developer environments, design tasks, and write tests that accept diverse correct solutions while excluding incorrect ones. Strong English (B2+) and 5+ years in software are required.