AI-Driven Quality Engineer & Test Automation

Baylor Scott & White Health; Hagåtña (GU); On-site; USD 110,000 - 165,000; Full time

Benefits offered by this job

Health and welfare benefits

401(k) savings plan with dollar-for-dl

Tuition Reimbursement

PTO accrual beginning Day 1

Job summary

Baylor Scott & White Health is seeking a Quality Engineer, AI & Test Automation to modernize its quality approach by moving toward automation-first, engineering-integrated, and AI-enabled testing across digital products and enterprise applications.

You will design, build, and maintain automated test suites for API, UI, data validation, and AI-enabled workflows, and integrate tests into CI/CD to accelerate delivery with higher confidence.

Qualifications

• 5–8+ years of experience in quality engineering, software testing, test automation, AI quality, or related technology delivery roles.
• Hands-on experience designing and implementing automated tests for APIs, web or mobile applications, workflows, data validation, integrations, or end-to-end product experiences.
• Experience working with engineering teams in agile, DevSecOps, CI/CD, or modern product-delivery environments.
• Experience with defect triage, root-cause analysis, test evidence documentation, release readiness, and quality metrics.
• Exposure to AI-enabled products, machine learning systems, large language models, conversational experiences, agentic workflows, automation, or decision-support technologies preferred.
• Healthcare, life sciences, financial services, or other regulated-industry experience preferred but not required.

Responsibilities

• Develop test strategies, test plans, acceptance criteria, and quality approaches for software and AI-enabled capabilities in partnership with Product, Engineering, Architecture, and business stakeholders.
• Translate requirements, user stories, workflows, APIs, data dependencies, and operational expectations into clear test scenarios and quality validation plans.
• Identify quality risks early in the delivery lifecycle and recommend appropriate validation approaches, including automated, manual, exploratory, integration, regression, performance, accessibility, or AI-specific evaluation methods.
• Provide clear release-readiness input based on test evidence, defect trends, quality metrics, risk assessment, and stakeholder expectations.
• Design, build, maintain, and improve automated test suites for API, UI, integration, end-to-end, regression, data, and workflow validation.
• Integrate automated tests into CI/CD pipelines and delivery workflows so quality signals are available earlier and more consistently throughout the development lifecycle.
• Create reusable test data, utilities, fixtures, scripts, and automation patterns that can be used across multiple teams and products.
• Improve test reliability, maintainability, execution time, coverage, and signal-to-noise ratio by reducing brittle scripts and eliminating repetitive manual validation where practical.

Skills

APIs testing

UI testing

CI/CD integration

Test automation

Python/JS/Java

Data validation

AI quality/testing

Root cause analysis

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related field

Tools

Playwright

Cypress

Selenium

Appium

PyTest

Postman

Job description

Baylor Scott & White Health is seeking a Quality Engineer, AI & Test Automation to modernize its quality approach by moving toward automation-first, engineering-integrated, and AI-enabled testing across digital products and enterprise applications.

You will design, build, and maintain automated test suites for API, UI, data validation, and AI-enabled workflows, and integrate tests into CI/CD to accelerate delivery with higher confidence.