Senior Software Engineer - AI Evaluation & Testing

Mindrift; United States; Remote; USD 28,000 - 55,000; Part time

Benefits offered by this job

Remote freelance project

Part-time engagement

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. You’ll create challenging tasks and evaluation criteria within realistic simulated environments.

Pay is per accepted task, with rates up to $40/hr; option for part-time, remote freelance work that fits around your schedule. English proficiency required; applicants submit CV in English.

Qualifications

• Master’s degree in CS or related field; bachelor accepted with 5+ years in field.
• 5+ years in software development with Python/JS tech stack.
• Experience writing functional and integration tests.
• English proficiency at B2+.

Responsibilities

• Build realistic developer environments (codebase, infra, tickets, docs).
• Design tasks from intermediate states and define success criteria.
• Write tests that accept all valid solutions and exclude incorrect ones.
• Iterate on tasks/tests based on QA feedback to ensure fairness.

Skills

5+ years in software development

English proficiency

Experience writing tests

Education

Master’s Degree in Computer Science or related fields

Bachelor’s degree with 5 years experience

Tools

Python (FastAPI)

JavaScript/TypeScript (React)

Docker

Postgres

Kafka

Redis

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. You’ll create challenging tasks and evaluation criteria within realistic simulated environments.

Pay is per accepted task, with rates up to $40/hr; option for part-time, remote freelance work that fits around your schedule. English proficiency required; applicants submit CV in English.