AI Testing Architect: Scenario Writing & Evaluation

Mindrift

Michigan

Remote

USD 90,921 - 129,494

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading technology connector in Michigan seeks experienced software developers for project-based AI opportunities. Candidates will need a degree in Computer Science or similar, and over 5 years of experience in software development, particularly in Python. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI models. Payment is competitive, with rates up to $80/hour depending on expertise. The role is flexible, allowing candidates to choose when and how to work.

Qualifications

  • 5+ years in software development, primarily Python.
  • Background in Full‑Stack development.
  • Experience with Docker and CI/CD tools.

Responsibilities

  • Review and refine realistic coding tasks.
  • Write comprehensive functional tests.
  • Analyze AI failures to understand model performance.

Skills

Python (pytest, async/await, subprocess, file operations)
Full‑Stack development
Experience writing functional and integration tests
Docker containers
CI/CD understanding (GitHub Actions)
English proficiency (B2)

Education

Degree in Computer Science, Software Engineering or related fields

Job description

A leading technology connector in Michigan seeks experienced software developers for project-based AI opportunities. Candidates will need a degree in Computer Science or similar, and over 5 years of experience in software development, particularly in Python. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI models. Payment is competitive, with rates up to $80/hour depending on expertise. The role is flexible, allowing candidates to choose when and how to work.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Testing Architect: Scenario Writing & Evaluation
AI Testing Architect: Scenario Writing & Evaluation

Mindrift • Kentucky

Remote
USD 55,104 - 110,208
AI Scenario Testing & Evaluation Lead (Project-Based)
AI Scenario Testing & Evaluation Lead (Project-Based)

Mindrift • New York (NY)

Remote
USD 90,921 - 129,494
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Oklahoma

Remote
USD 53,000 - 75,000
AI Scenario Testing & Evaluation Lead (Project-Based)
AI Scenario Testing & Evaluation Lead (Project-Based)

Mindrift • San Antonio (TX)

Remote
USD 90,921 - 129,494
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Colorado

Remote
USD 82,656 - 110,208
AI Evaluation Engineer (Contract) — Python QA & Testing
AI Evaluation Engineer (Contract) — Python QA & Testing

Mindrift • Missouri

Remote
USD 90,921 - 129,494
AI Software Test Engineer
AI Software Test Engineer

Procom • Ann Arbor (MI)

Hybrid
USD 90,000 - 120,000
Life Insurance
Disability Insurance
EAP
+4
AI Agent Testing & Evaluation Scenario Architect
AI Agent Testing & Evaluation Scenario Architect

Mindrift • Houston (TX)

Remote
USD 90,921 - 129,494
Get paid for your expertise
Flexible work schedule
Opportunity to work on advanced AI projects
AI Software Engineer — Code & Model Evaluation
AI Software Engineer — Code & Model Evaluation

AfterQuery Experts • Detroit (MI)

On-site
USD 90,000 - 120,000
Competitive pay
Flexible engagement
AI Systems Architect & Hands-On Technical Coach
AI Systems Architect & Hands-On Technical Coach

Intellibus • Phoenix (AZ)

On-site
USD 50,000 - 85,000