AI Coding Agent Evaluator & Task Designer

AI Chopping Block, Inc.

España

Remote

PHP 2,787,296 - 3,969,785

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Chopping Block, located in Romblon, España, is looking for experienced software developers to help build a dataset for evaluating AI coding agents. This project focuses on creating realistic tasks and environments that challenge AI models and require deep understanding of software development principles.

Applicants should have over 5 years of experience, proficiency in Python and JavaScript, and strong test writing skills. Compensation is project-based at up to $40/hr depending on experience and performance.

Qualifications

  • 5+ years in software development.
  • Experience with Python, Docker, and JavaScript/TypeScript.
  • Proficiency in writing tests (functional, integration).

Responsibilities

  • Build realistic developer environments for task evaluation.
  • Design tasks based on simulated environments.
  • Write tests to validate AI solutions.
  • Iterate on tasks based on feedback.

Skills

Software Development
Python (FastAPI)
JavaScript/TypeScript (React)
Docker
Postgres
Kafka
Redis
Test Writing
English Proficiency (B2+)

Job description

AI Chopping Block, located in Romblon, España, is looking for experienced software developers to help build a dataset for evaluating AI coding agents. This project focuses on creating realistic tasks and environments that challenge AI models and require deep understanding of software development principles.

Applicants should have over 5 years of experience, proficiency in Python and JavaScript, and strong test writing skills. Compensation is project-based at up to $40/hr depending on experience and performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Freelance Agent Evaluation Engineer
Freelance Agent Evaluation Engineer

AI Chopping Block, Inc. • España

Remote
PHP 2,787,296 - 3,969,785
Full-Stack Engineer, Part-Time AI Code Evaluation - Remote (Philippines)
Full-Stack Engineer, Part-Time AI Code Evaluation - Remote (Philippines)

OpenTrain AI • Philippines

Remote
PHP 4,346,000 - 8,691,000
Remote AI Coding Engineer — Evaluate AI Assistants
Remote AI Coding Engineer — Evaluate AI Assistants

Lifted, an Upwork Company™ • Manila

Remote
PHP 3,477,000 - 8,691,000
Fully remote freelance opportunity
Worldwide applicants welcome
Remote AI Training Task Architect (Freelance)
Remote AI Training Task Architect (Freelance)

TransPerfect • Cebu City

Remote
PHP 276,000 - 482,000
AI Quality & Evaluation Architect for LLM Systems
AI Quality & Evaluation Architect for LLM Systems

DutchTech • España

Hybrid
PHP 4,291,845 - 6,131,208
Stock options
Work & Swim program in Cyprus
Flexible work model across Europe
AI Code Engineer (Full-Stack) – Remote/Hybrid Barcelona
AI Code Engineer (Full-Stack) – Remote/Hybrid Barcelona

IOON • España

Hybrid
PHP 2,799,160 - 4,198,740
Remote Full-Stack Engineer for AI Code Evaluation - Part-Time
Remote Full-Stack Engineer for AI Code Evaluation - Part-Time

OpenTrain AI • Philippines

Remote
PHP 4,346,000 - 8,691,000
Software Developer – AI Coding Assistant Evaluation
Software Developer – AI Coding Assistant Evaluation

Lifted, an Upwork Company™ • Manila

Remote
PHP 3,477,000 - 8,691,000
Fully remote freelance opportunity
Worldwide applicants welcome
AI Code Evaluator & Quality Engineer
AI Code Evaluator & Quality Engineer

FEU • Philippines

Remote
PHP 450,000 - 750,000
AI Code Quality Engineer
AI Code Quality Engineer

St Mark's College • Philippines

Remote
PHP 600,000 - 900,000
Top locations