AI Software Test Engineer: Automate AI Validation & CI/CD

Experis Technology Group; Ann Arbor (MI); On-site; USD 62,000 - 66,000; Full time

Benefits offered by this job

Weekly Pay

Medical and Prescription Drug Plans

401(k) Plus Match

Dental Plan

Vision Plan

Job summary

ManpowerGroup, the parent company of Experis, seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI to own AI testing and automation with AI developers and product teams. You will design and execute testing strategies for AI-powered applications, ensuring production-ready quality and reliability.

The role emphasizes collaboration across engineering, product, and QA teams, with responsibilities spanning functional to performance testing, and building CI/CD pipelines for AI evaluation

Qualifications

• 3–6 years of software testing or QA automation experience.
• 1–3 years exposure to AI/ML or Generative AI technologies.
• Experience with Python, Java, JavaScript/TypeScript, or C# for automated testing.
• Experience with API testing and automation tools.

Responsibilities

• Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.
• Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.
• Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.
• Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.
• Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.

Skills

Python

Java

JavaScript/TypeScript

C#

API testing

CI/CD

Agile methodologies

SDLC

QA automation

Job description

ManpowerGroup, the parent company of Experis, seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI to own AI testing and automation with AI developers and product teams. You will design and execute testing strategies for AI-powered applications, ensuring production-ready quality and reliability.

The role emphasizes collaboration across engineering, product, and QA teams, with responsibilities spanning functional to performance testing, and building CI/CD pipelines for AI evaluation