Python Engineer - AI Coding Agent Tests (Project)

Dorado; United States; Remote; USD 61,992 - 103,320; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

Frontier coding agents are evaluated on how they pass tests—honestly, within scope, and without shortcuts. You will design tasks, write tests, and iterate based on QA feedback to ensure fair, robust evaluation.

Qualifications

• 4–5+ years in software development.
• Core stack: Python, JavaScript/TypeScript.
• Strong test design skills.
• Hands-on experience with coding agents (Claude Code, GitHub Copilot CLI, Codex, or similar).
• Familiarity with GitHub PRs and CI workflows as a user.
• English proficiency — B2+.

Responsibilities

• Design tasks that evaluate safety in AI coding agents.
• Write tests that catch unsafe shortcuts.
• Iterate tests based on QA feedback.
• Create realistic developer environments for evaluation.

Skills

4-5+ yrs exp

Python

JavaScript/TypeScript

Test design

Coding agents

GitHub PRs/CI

English B2+

Hands-on w/ coding agents

Tools

Claude Code

GitHub Copilot CLI

Codex

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

Frontier coding agents are evaluated on how they pass tests—honestly, within scope, and without shortcuts. You will design tasks, write tests, and iterate based on QA feedback to ensure fair, robust evaluation.