Remote AI Agent Evaluation Scenario Writer (QA Testing)

Mindrift; United States; Remote; USD 50,000 - 83,000; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for testing, evaluating, and improving AI systems. You’ll design tasks within realistic simulated environments and write tests that validate multiple correct solutions.

This freelance, remote role requires 5+ years in software development and a core stack of Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis, plus QA/testing experience. English proficiency (B2+) is required.

Qualifications

• 5+ years in software development.
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing tests (functional, integration).
• English proficiency - B2+.

Skills

Software development

English proficiency

QA/testing experience

Test design

Education

Master's degree in CS/SE/AI

Bachelor's + 5 years experience

Tools

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Job description

Mindrift connects specialists with project-based AI opportunities for testing, evaluating, and improving AI systems. You’ll design tasks within realistic simulated environments and write tests that validate multiple correct solutions.

This freelance, remote role requires 5+ years in software development and a core stack of Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis, plus QA/testing experience. English proficiency (B2+) is required.