Senior Python Engineer — AI Evaluation Tasks (Contract)

Explore more jobs; Kuwait City; On-site; KWD 20,000 - 33,000; Full time

Job summary

Mindrift seeks a seasoned software developer to help build a dataset for evaluating AI coding agents. You will craft realistic developer environments, formulate tasks from evolving codebases, and define rigorous, fair tests for agent solutions.

Required are 8+ years in software development and strong skills in Python (FastAPI), React/TypeScript, Docker, Postgres, Kafka, and Redis, plus experience writing tests and strong English proficiency (B2+).

Qualifications

• 8+ years of software development experience.
• Proficiency with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka and Redis.
• Experience writing functional and integration tests and English proficiency (B2+).

Responsibilities

• Create realistic developer environments and a believable development history for AI evaluation tasks.
• Design tasks from intermediate states, define success criteria, and ensure solvability by AI agents.
• Write tests that verify agent solutions, accepting all valid approaches and rejecting incorrect ones.
• Iterate on tasks and tests based on QA feedback to keep evaluations fair and robust.

Skills

Python

JavaScript/TypeScript

Docker

Postgres

Kafka

Redis

Testing

Tools

FastAPI

React

Docker

PostgreSQL

Kafka

Redis

Job description

Mindrift seeks a seasoned software developer to help build a dataset for evaluating AI coding agents. You will craft realistic developer environments, formulate tasks from evolving codebases, and define rigorous, fair tests for agent solutions.

Required are 8+ years in software development and strong skills in Python (FastAPI), React/TypeScript, Docker, Postgres, Kafka, and Redis, plus experience writing tests and strong English proficiency (B2+).