AI Coding Agent Evaluator & Task Designer

AI Chopping Block; España; On-site; PHP 2,787,296 - 3,969,785; Part time

Job summary

AI Chopping Block, located in Romblon, España, is looking for experienced software developers to help build a dataset for evaluating AI coding agents. This project focuses on creating realistic tasks and environments that challenge AI models and require deep understanding of software development principles.

Applicants should have over 5 years of experience, proficiency in Python and JavaScript, and strong test writing skills. Compensation is project-based at up to $40/hr depending on experience and performance.

Qualifications

• 5+ years in software development.
• Experience with Python, Docker, and JavaScript/TypeScript.
• Proficiency in writing tests (functional, integration).

Responsibilities

• Build realistic developer environments for task evaluation.
• Design tasks based on simulated environments.
• Write tests to validate AI solutions.
• Iterate on tasks based on feedback.

Skills

Software Development

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test Writing

English Proficiency (B2+)

Job description

AI Chopping Block, located in Romblon, España, is looking for experienced software developers to help build a dataset for evaluating AI coding agents. This project focuses on creating realistic tasks and environments that challenge AI models and require deep understanding of software development principles.

Applicants should have over 5 years of experience, proficiency in Python and JavaScript, and strong test writing skills. Compensation is project-based at up to $40/hr depending on experience and performance.