AI Quality Engineer - Test Automation & CI/CD

Randstad Digital Americas; Ann Arbor (MI); On-site; USD 56,000 - 60,000; Part time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

AD&D

Life insurance

Short-term disability

401K plan

Job summary

Randstad Digital Americas seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI, for a contract role. You will design, automate, and execute testing strategies for AI-powered applications and ML systems, focusing on reliability and governance.

The ideal candidate has a strong software testing background, automation framework experience, and interest in AI technologies, LLMs, agents, and RAG workflows. 8am-5pm, Bachelor’s degree required.

Qualifications

• AI evaluation, AI agents, and ML-driven testing knowledge.
• Experience validating AI outputs for accuracy, safety, and reliability.
• Strong testing framework design for AI-powered platforms and services.
• Familiarity with governance, security, and production-readiness in AI systems.

Responsibilities

• Develop comprehensive testing strategies for AI applications, platforms, and services.
• Validate AI model outputs for accuracy, consistency, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests for AI solutions.
• Create test cases for prompt-driven, agentic, and retrieval-based AI workflows.
• Validate AI guardrails, business rules, permissions, and governance controls.

Skills

AI evaluation

AI agents

Agile methodologies

AWS

API testing

JUnit

Kubernetes

GitHub Actions

Jenkins

Selenium

Playwright

Python

Java

Education

Bachelor's degree

Tools

Docker

Postman

GitHub Actions

Kubernetes

JUnit

Playwright

Selenium

PyTest

Jenkins

Job description

Randstad Digital Americas seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI, for a contract role. You will design, automate, and execute testing strategies for AI-powered applications and ML systems, focusing on reliability and governance.

The ideal candidate has a strong software testing background, automation framework experience, and interest in AI technologies, LLMs, agents, and RAG workflows. 8am-5pm, Bachelor’s degree required.