AI-Driven QA Automation Engineer – UI & API

Vizient, Inc.; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient, Inc. is seeking a dedicated Quality Engineer to design and execute quality engineering strategies for AI-powered applications and intelligent automation across enterprise platforms.

You will develop scalable test automation, implement AI validation, and promote responsible AI practices within a healthcare-focused software environment. The role emphasizes nondeterministic AI behavior, observability, and collaboration with cross-functional teams to ensure reliability, traceability, and

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows that improve quality, efficiency, and test coverage.
• Implement AI validation approaches, including functional, prompt, workflow, integration, regression, and human-in-the-loop testing, along with validation datasets and quality evaluation methods.
• Advance AI-assisted testing and modern quality engineering practices that address nondeterministic AI behavior, intelligent orchestration, and evolving healthcare workflows.
• Support runtime quality and reliability through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational clients to integrate quality practices throughout the software and AI development lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support activities across AI-enabled solutions.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools and technologies that improve scalability, reliability, and traceability.
• Mentor quality engineers and analysts by providing technical guidance, sharing automation practices, and fostering continuous learning and engineering discipline.
• Communicate quality risks, technical findings, implementation dependencies, and recommendations to technical and business clients while promoting continuous improvement and responsible AI adoption.

Job description

Vizient, Inc. is seeking a dedicated Quality Engineer to design and execute quality engineering strategies for AI-powered applications and intelligent automation across enterprise platforms.

You will develop scalable test automation, implement AI validation, and promote responsible AI practices within a healthcare-focused software environment. The role emphasizes nondeterministic AI behavior, observability, and collaboration with cross-functional teams to ensure reliability, traceability, and