Remote Freelance AI Evaluation Engineer — QA & Tests

Mindrift; México; Remote; MXN 636,000 - 1,017,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This freelance, remote role lets you build realistic developer environments, design tasks from intermediate states, and write tests to validate AI agent solutions.

You will work part-time on a remote basis, with compensation paid per accepted task up to $40/hr.

Qualifications

• Master’s Degree in Computer Science, Software Engineering, Data Science or related field.
• Bachelor’s degree accepted if candidate has 5+ years in the field.
• Minimum 3 years in QA-automation/testing or cybersecurity related roles.

Responsibilities

• Create challenging tasks and evaluation criteria within realistic simulated environments.
• Design tasks from intermediate states and ensure solvability for AI agents.
• Write tests that accept all valid approaches and reject incorrect ones.
• Iterate on tasks and tests based on QA feedback to ensure fair evaluation.

Skills

Software development

Python

JavaScript/TypeScript

Docker

Postgres

Kafka

Redis

Testing

English B2+

Education

Master’s Degree in CS/SE/AI (or related)

5+ years experience alternative (Bachelor)

Tools

FastAPI

React

Docker

PostgreSQL

Kafka

Redis

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This freelance, remote role lets you build realistic developer environments, design tasks from intermediate states, and write tests to validate AI agent solutions.

You will work part-time on a remote basis, with compensation paid per accepted task up to $40/hr.