Remote Evaluation Engineer for AI Task Testing (Freelance)

Mindrift; Doha; On-site; QAR 150,000 - 251,000; Part time

Benefits offered by this job

Remote freelance project

Part-time role

Flexible hours

Per-task pay

Job summary

Mindrift is seeking a seasoned software developer to join a part-time, remote freelance project. You will design and refine AI evaluation tasks, craft realistic developer environments, and write robust tests. Strong coding experience, testing discipline, and English proficiency are essential.

The role emphasizes flexible hours and outcome-driven payments. You will collaborate with peer researchers to build rigorous evaluation scenarios, ensuring multiple valid solutions and fair assessment

Qualifications

• 5+ years in software development.
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing tests (functional, integration).
• English proficiency - B2+.

Responsibilities

• Create challenging tasks and evaluation criteria within simulated environments.
• Design tasks from intermediate states of developer environments.
• Write tests that accept valid solutions and reject incorrect ones.
• Iterate on tasks and tests based on QA feedback.

Skills

Python

FastAPI

JavaScript

TypeScript

React

Docker

Postgres

Kafka

Redis

Testing

English B2+

Education

Master's Degree in Computer Science / Software Engineering / AI

Bachelor's Degree (if 5 years experience)

Tools

Python

FastAPI

React

Docker

Postgres

Kafka

Redis

Job description

Mindrift is seeking a seasoned software developer to join a part-time, remote freelance project. You will design and refine AI evaluation tasks, craft realistic developer environments, and write robust tests. Strong coding experience, testing discipline, and English proficiency are essential.

The role emphasizes flexible hours and outcome-driven payments. You will collaborate with peer researchers to build rigorous evaluation scenarios, ensuring multiple valid solutions and fair assessment