Senior Python Engineer — AI Evaluation & Testing Architect

Advanced Search; Bahrain; On-site; BHD 78,000 - 104,000; Full time

Job summary

Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments—tickets, docs, and a believable history of code changes. You’ll design tasks from intermediate states, craft prompts, and define what counts as a solved task, ensuring tests accept all valid approaches and reject incorrect ones.

This project-based role requires 8+ years in software development and English proficiency (B2+).

Qualifications

• 8+ years in software development.
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing tests (functional, integration).
• English proficiency - B2+.

Responsibilities

• Design evaluation tasks and tests for AI coding agents.
• Build realistic developer environments with codebases, infra, tickets and docs.
• Write tests that accept multiple valid solutions and reject incorrect ones.
• Iterate on tasks based on QA feedback to improve fairness and robustness.

Skills

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

PostgreSQL

Kafka

Redis

Testing (functional, integration)

English (B2+)

Tools

Docker

PostgreSQL

Kafka

Redis

FastAPI

React

Job description

Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments—tickets, docs, and a believable history of code changes. You’ll design tasks from intermediate states, craft prompts, and define what counts as a solved task, ensuring tests accept all valid approaches and reject incorrect ones.

This project-based role requires 8+ years in software development and English proficiency (B2+).