AI Coding Evaluation Engineer

Advanced Search; Kuwait City; On-site; KWD 13,000 - 21,000; Full time

Job summary

Mindrift is assembling a dataset to evaluate AI coding agents—focusing on testing, evaluating, and improving AI systems. You will craft challenging tasks in realistic simulated environments and write tests that accept all valid approaches while filtering out incorrect ones.

We seek developers with 5+ years of experience and a core stack in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis, plus strong testing skills and English proficiency.

Qualifications

• 5+ years of software development experience.
• Core stack includes Python (FastAPI) and JavaScript/TypeScript (React).
• English proficiency at B2+ level required.

Responsibilities

• Build realistic developer environments and a believable development history.
• Design tasks from intermediate states, define success criteria, and ensure solvability by AI agents.
• Write tests that validate agent solutions and accept all correct approaches while rejecting incorrect ones.
• Iterate on tasks and tests based on QA feedback to keep evaluation fair and robust.

Skills

Python

JavaScript/TypeScript

Testing

English Proficiency

Tools

FastAPI

React

Docker

Postgres

Kafka

Redis

Job description

Mindrift is assembling a dataset to evaluate AI coding agents—focusing on testing, evaluating, and improving AI systems. You will craft challenging tasks in realistic simulated environments and write tests that accept all valid approaches while filtering out incorrect ones.

We seek developers with 5+ years of experience and a core stack in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis, plus strong testing skills and English proficiency.