Senior QA Automation Engineer – Playwright / TypeScript / AI

CEI

Orlando (FL)

On-site

USD 83,000 - 110,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision
401(k) match

Job summary

CEI seeks a Senior QA Automation Engineer to own UI automation for AI-powered guest experiences. You will build end-to-end Playwright tests in TypeScript, validating non-deterministic AI responses and ensuring product quality across guest journeys.

You will work with product managers and engineers, translate Gherkin stories into automated tests, and integrate with Jenkins/Harness CI/CD to accelerate delivery. A Bachelor's degree is required for this role.

Qualifications

  • Bachelor's degree required.
  • Experience with Playwright, TypeScript, and automation testing.
  • Experience testing AI/LLM products and non-deterministic outputs.

Responsibilities

  • Translate user stories and acceptance criteria into automated Playwright/TypeScript tests.
  • Build and maintain end‑to‑end automated tests for guest journeys.
  • Validate UI against API responses and use mocking where appropriate.
  • Triage failures to identify root causes across app, automation, or data.
  • Collaborate with product managers and engineers to improve test coverage.

Skills

Playwright
TypeScript
AI/LLM testing
Gherkin
API testing
CI/CD
Communication

Education

Bachelor's degree

Tools

Playwright
Jenkins
Harness

Job description

Job at a Glance
  • Title: Senior QA Automation Engineer
  • Location: Orlando, FL | Glendale, CA | Anaheim, CA
  • Contract: Through March 2027, likelihood of extension up to 22 months
  • Pay: $70.00/hour + optional medical, dental, vision, 401(k) match
Overview

Our Client is seeking a Senior QA Tester to support a product team building AI-powered conversational experiences that help guests discover and plan theme park vacations. This role will be a primary contributor to the UI automation suite, with a strong emphasis on Playwright, TypeScript, end-to-end testing, and strategies for validating non-deterministic AI/LLM responses.
The ideal candidate has built and maintained production automation suites and is comfortable working directly with product managers, engineers, and content owners to translate Gherkin stories, acceptance criteria, and business rules into reliable automated tests.

Key Responsibilities
  • Become deeply familiar with product features, guest journeys, and business rules and serve as a knowledgeable voice on expected product behavior.
  • Translate Gherkin user stories, acceptance criteria, and business rules into automated Playwright and TypeScript tests.
  • Identify gaps and ambiguity in requirements before functionality is built.
  • Build and maintain end-to-end automated tests covering complete guest journeys.
  • Design rule-based, semantic, and evaluation-dataset approaches for testing non-deterministic AI/agent responses rather than relying on exact-string matching.
  • Develop reusable fixtures, authentication setup, helpers, and test data.
  • Validate UI experiences against API responses and use request interception and mocking where appropriate.
  • Execute automated test suites through Jenkins and Harness CI/CD pipelines.
  • Triage failures to determine whether root causes originate from the application, automation, environment, or test data.
  • Document clear, reproducible defects.
  • Use AI coding and agent tools to accelerate test creation, refactoring, and maintenance, and share effective approaches with the team.
Required Skills
  • Strong hands-on Playwright and TypeScript skills, including experience building and maintaining a production end-to-end automation suite.
  • Experience testing AI- or LLM-powered products and designing tests for non-deterministic output.
  • Demonstrable hands-on use of AI coding tools such as Claude, Copilot, or Cursor to accelerate test authoring and maintenance.
  • Fluency with Gherkin, acceptance criteria, and business rules.
  • Ability to quickly understand complex product domains and guest journeys.
  • API testing experience, including request interception and mocking.
  • Experience integrating or running automated test suites within Jenkins and/or Harness CI/CD.
  • Strong written communication and ability to work directly with product stakeholders in addition to engineering.
Required Education
  • Bachelor's degree required
Preferred Skills
  • Experience with LLM evaluation or observability tools such as Arize, Phoenix, LangSmith, or Promptfoo.
  • Experience testing travel, hospitality, e-commerce, or booking workflows.
  • Accessibility testing experience.
  • Visual regression testing experience.
  • Experience building agent- or MCP-driven test tooling.
Why Should I Apply?

This role offers the opportunity to work at the intersection of modern QA automation and generative AI. You will own meaningful portions of a Playwright/TypeScript automation suite while solving a newer testing challenge: determining how to reliably validate conversational AI experiences whose responses can legitimately vary between runs. The position also offers direct collaboration with product, engineering, and content stakeholders and encourages practical use of AI development tools.

About CEI

As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.
#ZR
#INDGEN

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior QA Automation Engineer
Senior QA Automation Engineer

Kelly Mitchell • Glendale (CA)

Hybrid
USD 68,000 - 96,000
Medical insurance
Dental insurance
Vision insurance
+2
QA Automation Engineer – Playwright & AI
QA Automation Engineer – Playwright & AI

American IT Systems • San Jose (CA)

On-site
USD 140,000 - 190,000
AI QA Automation Lead (Playwright/TypeScript)
AI QA Automation Lead (Playwright/TypeScript)

CEI • Orlando (FL)

On-site
USD 83,000 - 110,000
Medical, dental, vision
401(k) match
Senior Test Engineer / QA Automation Engineer
Senior Test Engineer / QA Automation Engineer

Site • United States

On-site
EUR 55,000 - 85,000
Flexible engagement model
Challenging projects
Security compliance
+1
Senior QA Engineer
Senior QA Engineer

Intercontinental Exchange Holdings • Atlanta (GA)

On-site
USD 110,000 - 150,000
AI Automation Engineer
AI Automation Engineer

Insight Global (United States) • Charlotte (NC)

Hybrid
USD 56,826 - 80,934
Senior QA Automation Engineer - AI Testing | Playwright & TS
Senior QA Automation Engineer - AI Testing | Playwright & TS

Kelly Mitchell • Glendale (CA)

Hybrid
USD 68,000 - 96,000
Medical insurance
Dental insurance
Vision insurance
+2
Senior QA Automation Engineer / SDET
Senior QA Automation Engineer / SDET

ZealHire Inc. • Boston (MA)

Hybrid
USD 120,000 - 160,000
Senior QA Automation Engineer (Playwright)
Senior QA Automation Engineer (Playwright)

Compunnel Inc. • Alpharetta (GA)

On-site
USD 110,000 - 140,000
Lead Test Automation Engineer – Playwright
Lead Test Automation Engineer – Playwright

Innocore Solutions, Inc. • Dallas (TX)

On-site
USD 130,000 - 170,000