QA Automation Engineer — AI‑Driven UI & API Systems

Vizient, Inc.; Irving (TX); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient, Inc. is seeking an AI Quality Engineer to design and execute quality strategies for AI-powered applications and integrated platforms.

You will develop scalable automation, implement AI validation, and collaborate across engineering, security, data, and clinical teams to ensure reliable software delivery. The role focuses on nondeterministic AI behavior, telemetry-driven quality, and production validation, with opportunities to mentor engineers and contribute to responsible AI practices

Qualifications

• Design and execute quality engineering strategies for AI-powered applications.
• Develop scalable test automation frameworks and reusable accelerators.
• Implement AI validation across functional, prompt and integration tests.
• Address nondeterministic AI behavior and evolving healthcare workflows.
• Support runtime quality via telemetry, observability, and monitoring.
• Collaborate across engineering, AIOps, security, data, and clinical teams.
• Coordinate test execution, defect management and release validation.
• Evaluate tooling to improve scalability, reliability and traceability.
• Mentor quality engineers and promote continuous learning.
• Communicate risks and findings to technical and business stakeholders.

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows.
• Implement AI validation approaches across functional, prompt, workflow, integration, regression, and human-in-the-loop testing.
• Advance AI-assisted testing and modern quality engineering practices addressing nondeterministic AI behavior.
• Support runtime quality via telemetry, observability, monitoring, drift detection, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational teams.
• Coordinate test execution, defect management, release validation, risk identification, and production support.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools.
• Mentor quality engineers and analysts with guidance on automation practices.
• Communicate quality risks and findings to technical and business clients.

Job description

Vizient, Inc. is seeking an AI Quality Engineer to design and execute quality strategies for AI-powered applications and integrated platforms.

You will develop scalable automation, implement AI validation, and collaborate across engineering, security, data, and clinical teams to ensure reliable software delivery. The role focuses on nondeterministic AI behavior, telemetry-driven quality, and production validation, with opportunities to mentor engineers and contribute to responsible AI practices