AI Testing Architect: Scenario Writing & Evaluation

Mindrift

Michigan

Remote

USD 90,921 - 129,494

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading technology connector in Michigan seeks experienced software developers for project-based AI opportunities. Candidates will need a degree in Computer Science or similar, and over 5 years of experience in software development, particularly in Python. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI models. Payment is competitive, with rates up to $80/hour depending on expertise. The role is flexible, allowing candidates to choose when and how to work.

Qualifications

  • 5+ years in software development, primarily Python.
  • Background in Full‑Stack development.
  • Experience with Docker and CI/CD tools.

Responsibilities

  • Review and refine realistic coding tasks.
  • Write comprehensive functional tests.
  • Analyze AI failures to understand model performance.

Skills

Python (pytest, async/await, subprocess, file operations)
Full‑Stack development
Experience writing functional and integration tests
Docker containers
CI/CD understanding (GitHub Actions)
English proficiency (B2)

Education

Degree in Computer Science, Software Engineering or related fields

Job description

A leading technology connector in Michigan seeks experienced software developers for project-based AI opportunities. Candidates will need a degree in Computer Science or similar, and over 5 years of experience in software development, particularly in Python. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI models. Payment is competitive, with rates up to $80/hour depending on expertise. The role is flexible, allowing candidates to choose when and how to work.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Testing Architect: Scenario Writing & Evaluation
AI Testing Architect: Scenario Writing & Evaluation

Mindrift • Kentucky

Remote
USD 10,000 - 60,000
AI Scenario Testing & Evaluation Lead (Project-Based)
AI Scenario Testing & Evaluation Lead (Project-Based)

Mindrift • New York (NY)

Remote
USD 10,000 - 60,000
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Oklahoma

Remote
USD 80,000 - 100,000
AI Scenario Testing & Evaluation Lead (Project-Based)
AI Scenario Testing & Evaluation Lead (Project-Based)

Mindrift • San Antonio (TX)

Remote
USD 10,000 - 60,000
AI Evaluation Engineer: Code & Test Automation
AI Evaluation Engineer: Code & Test Automation

Mindrift • United States

Remote
USD 80,000 - 100,000
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Colorado

Remote
USD 80,000 - 100,000
AI Architect & Developer
AI Architect & Developer

LEVI, RAY & SHOUP, INC • Illinois

Remote
Contract AI Evaluation Engineer: Functional Testing & QA
Contract AI Evaluation Engineer: Functional Testing & QA

Mindrift • Town of Florida (NY)

Remote
USD 80,000 - 100,000
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Missouri

Remote
USD 80,000 - 100,000
Remote AI Evaluation Scenario Designer
Remote AI Evaluation Scenario Designer

Mindrift • United States

Remote
USD 40,000 - 80,000