Senior AI Coding Agent Evaluation Engineer

Mindrift; Estado de México; Hybrid; MXN 480,083 - 960,167; Part time

Job summary

Mindrift is seeking experienced software developers for project-based AI evaluation tasks. Candidates will create realistic developer environments and design challenges to evaluate AI coding agents. This role requires at least 5 years of software development experience and proficiency in Python, JavaScript, and testing methodologies.

Compensation can go up to $40/hr based on experience and completion pace. Applicants must submit their CV in English.

Qualifications

• 5+ years in software development required.
• Experience in building realistic developer environments.
• Ability to design and evaluate AI task criteria.

Responsibilities

• Create challenging tasks for AI evaluation.
• Build virtual developer environments.
• Iterate tasks based on QA feedback.

Skills

Software development experience

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Test writing (functional, integration)

English proficiency B2+

Job description

Mindrift is seeking experienced software developers for project-based AI evaluation tasks. Candidates will create realistic developer environments and design challenges to evaluate AI coding agents. This role requires at least 5 years of software development experience and proficiency in Python, JavaScript, and testing methodologies.

Compensation can go up to $40/hr based on experience and completion pace. Applicants must submit their CV in English.