AI Coding Agent Evaluator — Contract, Project-Based

Mindrift; France; On-site; EUR 49,204 - 70,079; Part time

Job summary

Mindrift connects specialists to project-based AI opportunities, focused on evaluating AI coding agents. You'll develop realistic tasks and environments to assess AI capabilities in software development.

We seek candidates with 5+ years in software development, proficiency in Python and JavaScript/TypeScript, and the ability to write tests. Compensation is up to $50/hr depending on experience and efficiency.

Qualifications

• 5+ years in software development.
• Experience with Python and JavaScript/TypeScript.
• Ability to write functional and integration tests.
• Strong English proficiency (B2+).

Responsibilities

• Build realistic developer environments for AI evaluation.
• Design tasks and evaluation criteria with clarity.
• Write and iterate tests based on feedback.
• Guide and evaluate AI-generated solutions.

Skills

Software Development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test Writing (Functional, Integration)

English Proficiency (B2+)

Job description

Mindrift connects specialists to project-based AI opportunities, focused on evaluating AI coding agents. You'll develop realistic tasks and environments to assess AI capabilities in software development.

We seek candidates with 5+ years in software development, proficiency in Python and JavaScript/TypeScript, and the ability to write tests. Compensation is up to $50/hr depending on experience and efficiency.