AI Quality Assurance Engineer: Scalable Test Automation

Vizient; Irving (TX); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient in Irving, TX is seeking a Quality Engineer to design and execute quality strategies for AI-powered applications, APIs, and LLM-enabled workflows within healthcare platforms.

You will build scalable test automation, implement AI validation tests, and collaborate across engineering, security, data and clinical teams to ensure reliable, auditable software delivery. This role emphasizes nondeterministic AI behavior, telemetry, and production validation in complex enterprise environments.

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows that improve quality, efficiency, and test coverage.
• Implement AI validation approaches, including functional, prompt, workflow, integration, regression, and human-in-the-loop testing, along with validation datasets and quality evaluation methods.
• Advance AI-assisted testing and modern quality engineering practices that address nondeterministic AI behavior, intelligent orchestration, and evolving healthcare workflows.
• Support runtime quality and reliability through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational clients to integrate quality practices throughout the software and AI development lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support activities across AI-enabled solutions.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools and technologies that improve scalability, reliability, and traceability.
• Mentor quality engineers and analysts by providing technical guidance, sharing automation practices, and fostering continuous learning and engineering discipline.
• Communicate quality risks, technical findings, implementation dependencies, and recommendations to technical and business clients while promoting continuous improvement and responsible AI adoption.

Job description

Vizient in Irving, TX is seeking a Quality Engineer to design and execute quality strategies for AI-powered applications, APIs, and LLM-enabled workflows within healthcare platforms.

You will build scalable test automation, implement AI validation tests, and collaborate across engineering, security, data and clinical teams to ensure reliable, auditable software delivery. This role emphasizes nondeterministic AI behavior, telemetry, and production validation in complex enterprise environments.