Head of QA & AI Evaluation (Automation-First)

WebMD; Newark (NJ); On-site; USD 98,000 - 135,000; Full time

Benefits offered by this job

Health Insurance

Paid Time Off

401(k) Retirement Plan

Life and Disability Insurance

Employee Assistance Program

Job summary

WebMD Ignite, a division of WebMD and Internet Brands, seeks a Sr. Manager, Test Automation & AI Evaluation to elevate quality across the Ignite Growth Platform. You will champion automation, lead AI-powered QA initiatives, and drive release-readiness across teams.

You will mentor the existing QA team, develop evaluation frameworks for AI features, and partner with engineering, product, and DevOps to embed quality gates throughout the delivery lifecycle.

Qualifications

• 7+ years of quality engineering or test automation experience, including leadership responsibilities.
• Hands-on expertise with modern test automation frameworks (Playwright, Cypress, Selenium).
• Experience building automated test suites and integrating them into CI/CD pipelines.
• Experience designing evaluation methods for AI/ML or LLM-powered systems.
• Strong knowledge of test strategy, defect management, and release governance.

Responsibilities

• Lead an automation-first quality strategy across teams.
• Own modern test automation frameworks and end-to-end automated coverage.
• Build evaluation frameworks for AI-powered features and agentic systems.
• Apply AI to QA, including self-healing automation and AI-assisted test generation.
• Standardize quality engineering practices and drive accountability for release readiness.
• Provide management and mentorship to the Ignite QA function.

Skills

Quality engineering

Test automation

Leadership

AI evaluation

CI/CD integration

Playwright

Cypress

Selenium

Tools

Playwright

Cypress

Selenium

Job description

WebMD Ignite, a division of WebMD and Internet Brands, seeks a Sr. Manager, Test Automation & AI Evaluation to elevate quality across the Ignite Growth Platform. You will champion automation, lead AI-powered QA initiatives, and drive release-readiness across teams.

You will mentor the existing QA team, develop evaluation frameworks for AI features, and partner with engineering, product, and DevOps to embed quality gates throughout the delivery lifecycle.