AI Software Test Engineer – QA Automation for ML

Aquent; Ann Arbor (MI); On-site; USD 105,000 - 145,000; Full time

Benefits offered by this job

Health benefits

401(k) with match

Employee discounts

Job summary

Aquent Talent in Ann Arbor, MI area is seeking a Mid-Level AI Software Test Engineer to shape AI quality across its AI-powered applications. You will design automated tests, validate model outputs, and integrate testing into CI/CD while collaborating with AI engineers, product owners, and security teams to ensure reliability and responsible deployment.

This role emphasizes testing prompts, guardrails, and performance under load, with opportunities to build evaluation pipelines and contribute to

Qualifications

• Bachelor's degree in CS, software engineering, or related technical field.
• 3–6 years of progressive software testing/QA automation experience.
• Experience with API testing and automation tools (e.g., Postman).
• Strength in SDLC and Agile methodologies, with CI/CD integration.
• Experience testing distributed web/API systems and cloud platforms.
• Knowledge of Docker/Kubernetes and cloud (Azure/AWS/GCP).
• Familiarity with defect analysis and root-cause investigation.

Responsibilities

• Develop and implement testing strategies for AI applications and services.
• Validate AI model outputs for accuracy, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests.
• Create tests for prompt-driven, agentic, and retrieval-based AI workflows.
• Integrate AI testing into CI/CD pipelines and automate evaluation pipelines.
• Collaborate with software/AI engineers, product owners, and security teams.

Skills

Test automation

SDLC & Agile

CI/CD integration

Distributed systems testing

Quality engineering concepts

Cross-functional collaboration

Education

Bachelor's degree in CS or related field

Tools

Postman

Docker

Kubernetes

GitHub Actions

Jenkins

Azure

AWS

GCP

Selenium

Playwright

JUnit

PyTest

Job description

Aquent Talent in Ann Arbor, MI area is seeking a Mid-Level AI Software Test Engineer to shape AI quality across its AI-powered applications. You will design automated tests, validate model outputs, and integrate testing into CI/CD while collaborating with AI engineers, product owners, and security teams to ensure reliability and responsible deployment.

This role emphasizes testing prompts, guardrails, and performance under load, with opportunities to build evaluation pipelines and contribute to