Senior QA Automation Engineer for AI & Observability

Vizient; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient in Chicago is seeking an experienced quality engineer to shape AI-powered applications across healthcare workflows. You will design quality strategies, build scalable test automation, and integrate AI validation throughout the software lifecycle.

Join a collaborative, cross-functional team and mentor others while delivering reliable, observable systems. The role offers competitive compensation with an incentive program and a broad benefits plan, reflecting market norms for this senior

Qualifications

• Experience designing quality engineering strategies for AI-powered applications.
• Experience developing scalable test automation frameworks and validation processes.
• Knowledge of AI validation approaches including functional, prompt, workflow, and regression testing.
• Ability to mentor quality engineers and collaborate across teams.

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows that improve quality, efficiency, and test coverage.
• Implement AI validation approaches, including functional, prompt, workflow, integration, regression, and human-in-the-loop testing, along with validation datasets and quality evaluation methods.
• Advance AI-assisted testing and modern quality engineering practices that address nondeterministic AI behavior, intelligent orchestration, and evolving healthcare workflows.
• Support runtime quality and reliability through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational clients to integrate quality practices throughout the software and AI development lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support activities across AI-enabled solutions.
• Evaluate and implement testing, automation, observability, and AI quality engineering tools and technologies that improve scalability, reliability, and traceability.
• Mentor quality engineers and analysts by providing technical guidance, sharing automation practices, and fostering continuous learning and engineering discipline.
• Communicate quality risks, technical findings, implementation dependencies, and recommendations to technical and business clients while promoting continuous improvement and responsible AI adoption.

Job description

Vizient in Chicago is seeking an experienced quality engineer to shape AI-powered applications across healthcare workflows. You will design quality strategies, build scalable test automation, and integrate AI validation throughout the software lifecycle.

Join a collaborative, cross-functional team and mentor others while delivering reliable, observable systems. The role offers competitive compensation with an incentive program and a broad benefits plan, reflecting market norms for this senior