QA Automation Engineer – Agentic AI, UI, and API

Vizient; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient in Chicago is seeking an experienced quality engineer to shape AI-powered applications across healthcare workflows. You will design quality strategies, build scalable test automation, and integrate AI validation throughout the software lifecycle.

Join a collaborative, cross-functional team and mentor others while delivering reliable, observable systems. The role offers competitive compensation with an incentive program and a broad benefits plan, reflecting market norms for this senior

Qualifications

• Experience designing quality engineering strategies for AI-powered applications.
• Experience developing scalable test automation frameworks and validation processes.
• Knowledge of AI validation approaches including functional, prompt, workflow, and regression testing.
• Ability to mentor quality engineers and collaborate across teams.

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows that improve quality, efficiency, and test coverage.
• Implement AI validation approaches, including functional, prompt, workflow, integration, regression, and human-in-the-loop testing, along with validation datasets and quality evaluation methods.
• Advance AI-assisted testing and modern quality engineering practices that address nondeterministic AI behavior, intelligent orchestration, and evolving healthcare workflows.
• Support runtime quality and reliability through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational clients to integrate quality practices throughout the software and AI development lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support activities across AI-enabled solutions.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools and technologies that improve scalability, reliability, and traceability.
• Mentor quality engineers and analysts by providing technical guidance, sharing automation practices, and fostering continuous learning and engineering discipline.
• Communicate quality risks, technical findings, implementation dependencies, and recommendations to technical and business clients while promoting continuous improvement and responsible AI adoption.

Job description

Excited to grow your career?

We value our talented employees and instill an environment where you feel engaged, satisfied and able to contribute your unique skills and talents while living and working as your authentic self. We provide extensive opportunities for personal and professional development, building employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Our people make all the difference in our success.

Responsibilities:

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows that improve quality, efficiency, and test coverage.
• Implement AI validation approaches, including functional, prompt, workflow, integration, regression, and human-in-the-loop testing, along with validation datasets and quality evaluation methods.
• Advance AI-assisted testing and modern quality engineering practices that address nondeterministic AI behavior, intelligent orchestration, and evolving healthcare workflows.
• Support runtime quality and reliability through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational clients to integrate quality practices throughout the software and AI development lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support activities across AI-enabled solutions.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools and technologies that improve scalability, reliability, and traceability.
• Mentor quality engineers and analysts by providing technical guidance, sharing automation practices, and fostering continuous learning and engineering discipline.
• Communicate quality risks, technical findings, implementation dependencies, and recommendations to technical and business clients while promoting continuous improvement and responsible AI adoption.

Career Framework:

Professional - Senior Associate (P3)

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $102,400.00 to $179,000.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers