AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift; Roma; In loco; EUR 6915 - 27.660; Part-time

Descrizione del lavoro

Mindrift is seeking experienced software developers for project-based AI opportunities focusing on evaluating AI coding agents. You'll be tasked with building realistic development environments and designing challenging AI-related tasks.

Ideal candidates will have over 5 years of experience in software development, strong proficiency in Python and JavaScript frameworks, and a background in writing tests. Compensation is up to $40/hr based on experience and task completion speed.

Competenze

• 5+ years in software development.
• Experience writing functional and integration tests.
• Proficient in English (B2+).

Mansioni

• Build realistic developer environments with a codebase and context.
• Design tasks and define acceptance criteria for evaluating AI agents.
• Write tests to verify the correctness of AI solutions.
• Iterate on tasks based on QA feedback.

Conoscenze

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Writing tests (functional, integration)

English proficiency (B2+)

Descrizione del lavoro

Mindrift is seeking experienced software developers for project-based AI opportunities focusing on evaluating AI coding agents. You'll be tasked with building realistic development environments and designing challenging AI-related tasks.

Ideal candidates will have over 5 years of experience in software development, strong proficiency in Python and JavaScript frameworks, and a background in writing tests. Compensation is up to $40/hr based on experience and task completion speed.