AI Coding Agent Evaluator — Contract, Project-Based

Mindrift; Ireland; On-site; EUR 49,247 - 70,139; Part time

Job summary

Mindrift is looking for specialists to engage in project-based opportunities involving AI coding evaluation. As part of the project, you'll create realistic developer environments, design tasks for AI agents, and write tests to ensure quality solutions.

This role requires at least 5 years of software development experience and proficiency in technologies like Python and JavaScript. Compensation can reach up to $50/hr, based on performance and effort.

Qualifications

• 5+ years in software development.
• Experience with core stack technologies.

Responsibilities

• Build realistic developer environments including infrastructure and context.
• Design challenges that AI agents can solve.
• Write tests to verify agent solutions.
• Iterate on tasks based on QA feedback.

Skills

Software development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test writing (functional, integration)

English proficiency (B2+)

Job description

Mindrift is looking for specialists to engage in project-based opportunities involving AI coding evaluation. As part of the project, you'll create realistic developer environments, design tasks for AI agents, and write tests to ensure quality solutions.

This role requires at least 5 years of software development experience and proficiency in technologies like Python and JavaScript. Compensation can reach up to $50/hr, based on performance and effort.