AI QA Automation Engineer: UI, API & LLM Testing

Vizient, Inc.; Edina (MN); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient, Inc. in Minnesota is seeking a senior Quality Engineer for AI-powered applications. You will design and execute quality engineering strategies across AI workflows, interfaces, APIs, and LLM-enabled processes, and mentor junior engineers.

You will develop scalable test automation, validation methods, and observability practices to ensure reliable performance in production. Collaboration with engineering, security, data and clinical teams is essential.

Qualifications

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.

Responsibilities

• Design and execute quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, intelligent automation, and integrated enterprise platforms.
• Develop scalable test automation frameworks and validation processes that improve quality and test coverage.
• Implement AI validation approaches including functional, prompt, workflow, integration, regression, and human-in-the-loop testing.
• Advance AI-assisted testing and modern quality engineering practices addressing nondeterministic AI behavior and healthcare workflows.
• Collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational teams to integrate quality practices across the lifecycle.
• Coordinate test execution, defect management, release validation, risk identification, and production support for AI-enabled solutions.
• Evaluate and implement testing and observability tools to improve scalability, reliability and traceability.
• Mentor quality engineers and analysts in automation practices and continuous learning.
• Communicate risks and findings to technical and business stakeholders to drive responsible AI adoption.

Job description

Vizient, Inc. in Minnesota is seeking a senior Quality Engineer for AI-powered applications. You will design and execute quality engineering strategies across AI workflows, interfaces, APIs, and LLM-enabled processes, and mentor junior engineers.

You will develop scalable test automation, validation methods, and observability practices to ensure reliable performance in production. Collaboration with engineering, security, data and clinical teams is essential.