Mid-Level AI Software Test Engineer

Experis Technology Group; Ann Arbor (MI); On-site; USD 62,000 - 66,000; Full time

Benefits offered by this job

Weekly Pay

Medical and Prescription Drug Plans

401(k) Plus Match

Dental Plan

Vision Plan

Job summary

ManpowerGroup, the parent company of Experis, seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI to own AI testing and automation with AI developers and product teams. You will design and execute testing strategies for AI-powered applications, ensuring production-ready quality and reliability.

The role emphasizes collaboration across engineering, product, and QA teams, with responsibilities spanning functional to performance testing, and building CI/CD pipelines for AI evaluation

Qualifications

• 3–6 years of software testing or QA automation experience.
• 1–3 years exposure to AI/ML or Generative AI technologies.
• Experience with Python, Java, JavaScript/TypeScript, or C# for automated testing.
• Experience with API testing and automation tools.

Responsibilities

• Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.
• Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.
• Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.
• Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.
• Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.

Skills

Python

Java

JavaScript/TypeScript

C#

API testing

CI/CD

Agile methodologies

SDLC

QA automation

Job description

Our client, [Industry Descriptor] is seeking a Mid-Level AI Software Test Engineer to join their team. As a Mid-Level AI Software Test Engineer, you will be part of the [Department Name] supporting [Team Name(s)]. The ideal candidate will have a strong software testing foundation, the ability to independently own AI testing and automation efforts, and a collaborative mindset to partner with AI developers, architects, and product teams to help deliver production-quality AI solutions.

Job Title:Mid-Level AI Software Test Engineer

Location:Ann Arbor, MI

Pay Range:$45-$48/hr

What's the Job?

• Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.
• Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.
• Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.
• Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.
• Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.

What's Needed?

• 3–6 years of software testing, QA automation, or quality engineering experience, with 1–3 years of exposure to AI/ML or Generative AI technologies.
• Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.
• Strong understanding of test automation, SDLC, Agile methodologies, and CI/CD pipelines.
• Experience with API testing and automation tools, plus testing distributed systems, web applications, and APIs.
• Ability to independently own AI testing and automation efforts while collaborating closely with AI developers, architects, and product teams.

What's in it for me?

• Opportunity to combine traditional software quality engineering with emerging AI validation techniques to help ensure AI systems are reliable and production-ready.
• Ownership of automated AI evaluation and regression detection to improve confidence in AI model and agent behavior.
• Hands-on experience testing prompt-driven, agentic, and retrieval-based AI workflows, including RAG and tool-calling integrations.
• Collaboration with cross-functional teams to strengthen quality standards, best practices, and production readiness.
• Clear success measures focused on reducing AI release regressions and improving safe, scalable delivery of AI-powered features.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.