AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift; Italia; In loco; EUR 23.819 - 47.639; Tempo pieno

Descrizione del lavoro

Mindrift is seeking specialists for project-based AI opportunities focused on evaluating AI coding agents. You will build realistic developer environments, design challenging tasks, and write tests to evaluate solutions.

The role requires over 5 years of software development experience and proficiency in Python (FastAPI) and JavaScript (React). This position offers flexibility in hours, with compensation of up to $40/hr based on performance.

Competenze

• 5+ years in software development.
• Experience writing functional and integration tests.
• Deep understanding of AI coding tasks.

Mansioni

• Build realistic developer environments with codebase and infrastructure.
• Design tasks that challenge AI coding models.
• Write tests to verify agent solutions.

Conoscenze

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

English proficiency (B2+)

Descrizione del lavoro

Mindrift is seeking specialists for project-based AI opportunities focused on evaluating AI coding agents. You will build realistic developer environments, design challenging tasks, and write tests to evaluate solutions.

The role requires over 5 years of software development experience and proficiency in Python (FastAPI) and JavaScript (React). This position offers flexibility in hours, with compensation of up to $40/hr based on performance.