Senior Python Engineer - AI Task Design (Project-based)

Employment; Bahrain; On-site; BHD 21,000 - 34,000; Full time

Job summary

Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments and evaluation tasks. You design prompts, define success criteria, and write tests that accommodate multiple correct approaches.

This role focuses on guiding task quality, not writing full code from scratch, with engagement-based compensation. The project requires 8+ years in software development and experience writing tests, plus the ability to craft fair, robust evaluation scenarios and

Qualifications

• 8+ years in software development.
• Experience writing tests (functional, integration).

Responsibilities

• Design tasks and evaluation criteria for AI coding agents.
• Write tests that accept multiple valid solutions.
• Iterate on tasks based on QA feedback.
• Coordinate with project team to ensure fairness.

Skills

8+ years software development

Testing experience

Job description

Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments and evaluation tasks. You design prompts, define success criteria, and write tests that accommodate multiple correct approaches.

This role focuses on guiding task quality, not writing full code from scratch, with engagement-based compensation. The project requires 8+ years in software development and experience writing tests, plus the ability to craft fair, robust evaluation scenarios and