AI Coding Agent Evaluator — Contract, Project-Based

Mindrift; France; Sur place; EUR 49 204 - 70 079; Temps partiel

Résumé du poste

Mindrift connects specialists to project-based AI opportunities, focused on evaluating AI coding agents. You'll develop realistic tasks and environments to assess AI capabilities in software development.

We seek candidates with 5+ years in software development, proficiency in Python and JavaScript/TypeScript, and the ability to write tests. Compensation is up to $50/hr depending on experience and efficiency.

Qualifications

• 5+ years in software development.
• Experience with Python and JavaScript/TypeScript.
• Ability to write functional and integration tests.
• Strong English proficiency (B2+).

Responsabilités

• Build realistic developer environments for AI evaluation.
• Design tasks and evaluation criteria with clarity.
• Write and iterate tests based on feedback.
• Guide and evaluate AI-generated solutions.

Connaissances

Software Development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test Writing (Functional, Integration)

English Proficiency (B2+)

Description du poste

Mindrift connects specialists to project-based AI opportunities, focused on evaluating AI coding agents. You'll develop realistic tasks and environments to assess AI capabilities in software development.

We seek candidates with 5+ years in software development, proficiency in Python and JavaScript/TypeScript, and the ability to write tests. Compensation is up to $50/hr depending on experience and efficiency.