AI Agent Evaluation Engineer (Project-Based)

Mindrift; Germany (OH); On-site; USD 55,104 - 68,880; Part time

Job summary

Mindrift is offering project-based AI opportunities for seasoned software developers based in the United States. The position involves building realistic developer environments and evaluating AI coding agents.

Ideal candidates will have over 5 years of experience in software development with proficiency in Python, JavaScript, Docker, and more. This role offers flexibility as tasks can be completed remotely on a schedule you set, with compensation up to $50 per hour.

Qualifications

• Minimum 5 years of software development experience required.
• Familiarity with AI-related tasks and coding scenarios necessary.
• Ability to evaluate and articulate task complexities.

Responsibilities

• Build realistic developer environments for AI evaluations.
• Design and iterate on tasks based on agent performance.
• Write and verify tests for agent solutions.

Skills

5+ years in software development

Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis

Experience writing tests (functional, integration)

English proficiency—B2+

Job description

Mindrift is offering project-based AI opportunities for seasoned software developers based in the United States. The position involves building realistic developer environments and evaluating AI coding agents.

Ideal candidates will have over 5 years of experience in software development with proficiency in Python, JavaScript, Docker, and more. This role offers flexibility as tasks can be completed remotely on a schedule you set, with compensation up to $50 per hour.