AI Scenario Testing & Evaluation Lead (Project-Based)

Mindrift; New York (NY); Remote; USD 90,921 - 129,494; Part time

Job summary

A technology company based in New York is seeking specialists for project-based AI opportunities focusing on testing and improving AI systems. This position requires 5+ years of software development experience, primarily in Python, along with a solid background in full-stack development. Participants will handle realistic coding tasks and AI evaluation challenges, with rates up to $80/hour. The work allows for flexible hours depending on task complexity.

Qualifications

• 5+ years in software development, primarily Python.
• Experience writing tests (functional, integration).
• Background in Full‑Stack development with focus on React and Back‑end systems.

Responsibilities

• Review and refine coding tasks based on production codebases.
• Write comprehensive functional tests for end-to-end behavior.
• Analyze AI failures and iterate based on feedback.

Skills

Python

Software Development

Full-Stack Development

Docker

CI/CD

English proficiency - B2

Education

Degree in Computer Science or Software Engineering

Tools

pytest

React

Job description

A technology company based in New York is seeking specialists for project-based AI opportunities focusing on testing and improving AI systems. This position requires 5+ years of software development experience, primarily in Python, along with a solid background in full-stack development. Participants will handle realistic coding tasks and AI evaluation challenges, with rates up to $80/hour. The work allows for flexible hours depending on task complexity.