Project-Based Senior Software Engineer, AI Task Evaluation

AI Chopping Block; Town of Poland (NY); On-site; USD 33,062 - 55,104; Full time

Job summary

Mindrift is building a dataset to evaluate AI coding agents by creating tasks, tests, and realistic environments for AI agents to solve. You’ll design tasks, write tests, and iterate based on QA feedback, ensuring a range of valid solutions are accepted.

This is a project-based, non-permanent role focused on evaluating and refining model performance. We look for developers with 5+ years of software experience and a strong stack (Python/FastAPI, React, Docker, Postgres, Kafka, Redis) and solid

Qualifications

• 5+ years in software development.
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing tests (functional, integration).
• English proficiency - B2+.

Skills

5+ years in software development

Python

JavaScript/TypeScript

Docker

Postgres

Kafka

Redis

Testing

Tools

FastAPI

React

Docker

Postgres

Kafka

Redis

Job description

Mindrift is building a dataset to evaluate AI coding agents by creating tasks, tests, and realistic environments for AI agents to solve. You’ll design tasks, write tests, and iterate based on QA feedback, ensuring a range of valid solutions are accepted.

This is a project-based, non-permanent role focused on evaluating and refining model performance. We look for developers with 5+ years of software experience and a strong stack (Python/FastAPI, React, Docker, Postgres, Kafka, Redis) and solid