AI Agent Evaluation Engineer - Remote, Freelance

Mindrift; Kuwait; On-site; KWD 13,000 - 21,000; Part time

Benefits offered by this job

Remote work

Freelance project paid per task

Flexible schedule

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a part-time, remote, freelance project.

You will build realistic developer environments, create tasks, write tests, and evaluate agent solutions. Requirements include 5+ years in software development, core stack Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis, and experience writing tests; English

Qualifications

• 5+ years in software development with strong Python/JS/TS background.
• Experience with testing (functional/integration) and QA processes.
• English proficiency at least B2+.
• Familiarity with building realistic task environments and evaluation criteria.

Responsibilities

• Design tasks and evaluation criteria within realistic simulated environments.
• Build realistic developer environments with codebases, infra, and context.
• Write tests that validate agent solutions and accept all valid approaches.
• Iterate on tasks/tests based on QA feedback to ensure fairness and robustness.

Skills

Python

JavaScript/TypeScript

Testing

English (B2+)

Education

Master's Degree in Computer Science or related field

Bachelor’s degree with 5+ years experience accepted

Tools

FastAPI

React

Docker

PostgreSQL

Kafka

Redis

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a part-time, remote, freelance project.

You will build realistic developer environments, create tasks, write tests, and evaluate agent solutions. Requirements include 5+ years in software development, core stack Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis, and experience writing tests; English