AI Coding Agent Evaluator (Project-Based)

Mindrift; Poland; On-site; PLN 100,960 - 201,920; Part time

Job summary

Mindrift is offering a project-based opportunity in Poland where specialists will evaluate AI coding agents. Candidates with over 5 years in software development and a strong proficiency in English (B2+) are encouraged to apply.

You will create realistic developer environments and tasks, create tests to verify solutions, and engage in continuous improvement based on feedback. Compensation can be up to $30 per hour, based on experience and delivery pace.

Qualifications

• 5+ years in software development.
• Experience in building realistic developer environments.
• Ability to write tests that verify agent solutions.

Responsibilities

• Create challenging tasks and evaluation criteria for AI coding agents.
• Iterate on tasks and tests based on QA feedback.
• Ensure tasks are solvable by AI agents.

Skills

Software development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test writing (functional, integration)

English proficiency (B2+)

Job description

Mindrift is offering a project-based opportunity in Poland where specialists will evaluate AI coding agents. Candidates with over 5 years in software development and a strong proficiency in English (B2+) are encouraged to apply.

You will create realistic developer environments and tasks, create tests to verify solutions, and engage in continuous improvement based on feedback. Compensation can be up to $30 per hour, based on experience and delivery pace.