Mid-Level AI QA Engineer – Testing & Automation

Aquent; Ann Arbor (MI); On-site; USD 90,000 - 120,000; Full time

Job summary

Aquent partners with a cutting-edge organization to shape the future of AI quality. The Mid-Level AI Software Test Engineer will design, automate, and execute testing strategies for AI-powered applications, ML systems, and autonomous agents.

You will validate model outputs, guardrails, and governance to ensure responsible deployment and high-quality experiences. Join a team focused on scalable AI features, rigorous testing, and production-ready solutions, collaborating with software and AI

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related technical field.
• 3-6 years of progressive experience in software testing, QA automation, or quality engineering.
• Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.
• Demonstrated API testing experience with tools like Postman.
• Strong understanding of test automation principles and SDLC/Agile.
• Experience integrating testing into CI/CD pipelines (GitHub Actions, Jenkins).
• Experience testing distributed systems, web apps, and APIs.
• Familiarity with Docker and Kubernetes.
• Experience with cloud platforms (Azure, AWS, or GCP).
• Proficiency in quality engineering concepts including Defect Analysis and Root Cause Investigation.

Responsibilities

• Develop and implement comprehensive testing strategies for AI applications and services.
• Validate AI model outputs for accuracy, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests for AI solutions.
• Create test cases for prompt-driven, agentic, and retrieval-based AI workflows.
• Validate guardrails, permissions, and governance controls for responsible AI deployment.
• Perform adversarial, negative, and edge-case testing to identify failures and hallucinations.
• Build automated test frameworks for AI applications and CI/CD integration.
• Develop automated evaluation pipelines for AI responses and workflows.
• Create reusable test data, mocks, simulators, and validation frameworks.

Skills

Python

Java

JavaScript/TypeScript

C#

API testing

CI/CD

Git

Education

Bachelor's degree in CS/SE

Tools

Postman

Docker

Kubernetes

Azure

AWS

GCP

Selenium

Playwright

JUnit

PyTest

Job description

Aquent partners with a cutting-edge organization to shape the future of AI quality. The Mid-Level AI Software Test Engineer will design, automate, and execute testing strategies for AI-powered applications, ML systems, and autonomous agents.

You will validate model outputs, guardrails, and governance to ensure responsible deployment and high-quality experiences. Join a team focused on scalable AI features, rigorous testing, and production-ready solutions, collaborating with software and AI