Software Developer Engineer Test - Mid-Level

Randstad Digital Americas; Ann Arbor (MI); Sur place; USD 56 000 - 60 000; Temps partiel

Avantages offerts par ce poste

Medical insurance

Dental insurance

Vision insurance

AD&D

Life insurance

Short-term disability

401K plan

Résumé du poste

Randstad Digital Americas seeks a Mid-Level AI Software Test Engineer in Ann Arbor, MI, for a contract role. You will design, automate, and execute testing strategies for AI-powered applications and ML systems, focusing on reliability and governance.

The ideal candidate has a strong software testing background, automation framework experience, and interest in AI technologies, LLMs, agents, and RAG workflows. 8am-5pm, Bachelor’s degree required.

Qualifications

• AI evaluation, AI agents, and ML-driven testing knowledge.
• Experience validating AI outputs for accuracy, safety, and reliability.
• Strong testing framework design for AI-powered platforms and services.
• Familiarity with governance, security, and production-readiness in AI systems.

Responsabilités

• Develop comprehensive testing strategies for AI applications, platforms, and services.
• Validate AI model outputs for accuracy, consistency, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests for AI solutions.
• Create test cases for prompt-driven, agentic, and retrieval-based AI workflows.
• Validate AI guardrails, business rules, permissions, and governance controls.

Connaissances

AI evaluation

AI agents

Agile methodologies

AWS

API testing

JUnit

Kubernetes

GitHub Actions

Jenkins

Selenium

Playwright

Python

Java

Formation

Bachelor's degree

Outils

Docker

Postman

GitHub Actions

Kubernetes

JUnit

Playwright

Selenium

PyTest

Jenkins

Description du poste

Job Summary

Position Summary

We are seeking a Mid-Level AI Software Test Engineer to design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions. This role combines traditional software quality engineering with emerging AI validation techniques to ensure AI systems are reliable, safe, accurate, performant, and production-ready.

The ideal candidate has a strong software testing background, experience building automated test frameworks, and an interest in AI technologies such as LLMs, agents, RAG systems, MCP integrations, and machine learning models. AI engineering organizations increasingly emphasize AI evaluation frameworks, automation, reliability, governance, and production quality, making testing a critical function in AI delivery.

location: Ann Arbor, Michigan

job type: Contract

salary: $40.81 - 43.81 per hour

work hours: 8am to 5pm

education: Bachelors

Responsibilities

Key Responsibilities

AI Quality Engineering

• Develop comprehensive testing strategies for AI applications, platforms, and services.
• Validate AI model outputs for accuracy, consistency, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests for AI solutions.
• Create test cases for prompt-driven, agentic, and retrieval-based AI workflows.
• Validate AI guardrails, business rules, permissions, and governance controls.
• Perform adversarial, negative, and edge-case testing to identify model failures and hallucinations.

Automation

• Build and maintain automated test frameworks for AI applications.
• Develop automated evaluation pipelines for AI responses and workflows.
• Integrate AI testing into CI/CD pipelines.
• Implement automated quality scoring and regression detection.
• Create reusable test data, mocks, simulators, and validation frameworks.

Platform & Integration Testing

• Test AI agents, workflows, APIs, MCP integrations, and tool-calling capabilities.
• Validate integrations with external systems, data sources, and enterprise services.
• Verify performance, reliability, scalability, and resiliency of AI workloads.
• Execute load and stress testing for AI services.

Collaboration

• Partner with software engineers, AI engineers, product owners, architects, and security teams.
• Participate in design reviews and provide quality feedback during development.
• Contribute to test strategy, quality standards, and best practices.
• Support production readiness reviews and defect triage activities.

Qualifications

skills:

AI evaluation,AI agents,Agile methodologies,AWS,API testing,APIs,AI,AI technologies,AI engineering,AI solutions,automated test,QA automation,Test automation,C#,Claude,Cloud,distributed systems,Docker,generative AI solutions,Generative AI applications,LLM-based systems,Generative AI technologies,GitHub Actions,GCP,Gemini,Hallucination Detection,Information Systems,Computer Science,Integration Testing,Java,JavaScript,Jenkins,JUnit,Kubernetes,LLMs,Load Testing,machine learning models,machine learning systems,Azure,copilots,OpenAI,Performance Testing,Playwright,Postman,PyTest,Python,Regression Testing,RAG,Selenium,AI-powered applications,Software Engineering,Software development lifecycle,software quality,AI Safety,cloud-native applications,testing strategies,SDLC,integrations,Software Test,software testing,TypeScript,web applications,reliability,automate,automation,automation tools,benchmarking,enterprise governance,responsible AI,Defect Analysis,governance,AI governance,AI systems,production quality,quality engineering,compliance requirements,risk,risk management practices,Root Cause Investigation,Security Testing,testing,validation techniques

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [e-mail].

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.