AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift; Madrid; Presencial; EUR 23.819 - 47.639; A tiempo parcial

Descripción de la vacante

Mindrift is seeking experienced software developers to work on a project evaluating AI coding agents. This opportunity involves building realistic developer environments and designing tasks that test AI models.

Ideal candidates will have 5+ years of experience, knowledge in Python and JavaScript, and a strong ability to create and write tests. You will work on a project basis and get compensated up to $40/hr depending on your expertise and pace.

Formación

• 5+ years in software development.
• Experience in core technologies like Python, JavaScript, Docker.
• Ability to write functional and integration tests.

Responsabilidades

• Build realistic developer environments with a codebase and infrastructure.
• Design tasks that challenge AI coding models effectively.
• Write tests to verify AI agent solutions, managing acceptance criteria.

Conocimientos

Software Development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test Writing (Functional, Integration)

English (B2+)

Descripción del empleo

Mindrift is seeking experienced software developers to work on a project evaluating AI coding agents. This opportunity involves building realistic developer environments and designing tasks that test AI models.

Ideal candidates will have 5+ years of experience, knowledge in Python and JavaScript, and a strong ability to create and write tests. You will work on a project basis and get compensated up to $40/hr depending on your expertise and pace.