Senior Python Engineer - AI Testing & Evaluation (Contract)

Mindrift; Philippines; On-site; PHP 3,401,481 - 5,102,222; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems.

In this role, you will design tasks that reveal unsafe shortcuts, write robust tests, and assess agent solutions across realistic repositories. This is project-based work, not permanent employment, with hours around 20–25 per week and compensation up to $60 per hour equivalent.

Qualifications

• 4–5+ years in software development.
• Strong test design for functional and integration tests.
• Proficiency with Python and JavaScript/TypeScript.
• Experience with coding agents like Claude Code or Codex.
• Familiarity with GitHub PRs and CI workflows.
• English proficiency level at least B2+.

Responsibilities

• Design tasks and datasets for AI coding agents.
• Write tests that verify safe and correct agent behavior.
• Create realistic development environments and datasets.
• Iterate on tasks and tests based on QA feedback.

Skills

4–5+ years software development

Python

JavaScript/TypeScript

Test design (functional & integration)

Coding agents experience

GitHub PRs & CI workflows

Full-stack exposure

English proficiency (B2+)

Tools

Claude Code

GitHub Copilot CLI

Codex

GitHub CI

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems.

In this role, you will design tasks that reveal unsafe shortcuts, write robust tests, and assess agent solutions across realistic repositories. This is project-based work, not permanent employment, with hours around 20–25 per week and compensation up to $60 per hour equivalent.