Lead Software Test Automation Engineer - Test Architect - Agentic AI

C T Corporation System (DE)

Coppell (TX)

On-site

USD 90,000 - 157,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Wolters Kluwer is seeking a Lead Test Automation Architect to define and lead an enterprise-grade test automation strategy across UI, API, data, and platform layers, supporting Agentic AI/LLM-based systems. You will architect scalable automation frameworks, drive engineering excellence, and accelerate delivery through productive, maintainable automation programs.

The role requires 8-12+ years in Quality Engineering with architect-level ownership, expertise in API/UI testing, and strong

Qualifications

  • 8-12+ years in Quality Engineering / Test Automation with architect-level ownership of frameworks and strategy.
  • Experience designing scalable automation across API testing, UI automation, and test data strategy.
  • Strong programming skills in at least one modern language (Java, Python, TypeScript/JS, C#).
  • Expertise with automation tools/frameworks (UI: Playwright/Selenium, API: REST-assured/Postman).
  • Demonstrated ability to reduce flakiness and accelerate test execution.

Responsibilities

  • Define and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e).
  • Establish automation standards, patterns, and reference implementations.
  • Drive shift-left testing practices and reduce reliance on fragile end-to-end tests.
  • Design and implement AI/non-deterministic test approaches (confidence-based checks, rubric validation).
  • Partner with ML/AI, Product, and Engineering to set acceptance criteria and quality gates.
  • Build scalable automation programs that are fast, reliable, and easy to extend.
  • Integrate automation into CI/CD with quality gates and observability.

Skills

Quality Eng
Test Automation
API testing
UI automation
Programming languages

Tools

Playwright
Selenium
Postman
GitHub Actions
Jenkins

Job description

We are seeking a Lead Test Automation Architect to define and lead an enterprise-grade test automation strategy across UI, API, data, and platform layers-while evolving our quality engineering capabilities to support Agentic AI / LLM-based systems (probabilistic outputs, confidence-based validation, hallucination detection, and model evaluation). This role will architect scalable automation frameworks, drive engineering excellence, and accelerate delivery through highly productive, maintainable automation programs.

Key Responsibilities
Automation Strategy & Architecture

Define and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.

Establish automation standards, patterns, and reference implementations (framework structure, page-object/screenplay usage, test data patterns, reporting).

Drive shift-left testing practices (contract testing, component testing, pre-merge validation) and reduce reliance on fragile end-to-end tests.

Agentic AI / LLM Test Model Alignment
  • Design and implement testing approaches for non-deterministic AI outputs , including:
  • confidence/threshold-based assertions
  • semantic similarity checks and rubric-based validation
  • goldens/benchmark datasets and evaluation harnesses
  • hallucination and groundedness testing strategies
  • regression detection across model/prompt/version changes

Define AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability .

Partner with ML/AI, Product, and Engineering to establish acceptance criteria for AI capabilities and measurable quality gates.

High-Productivity Automation Programs

Build and scale high-throughput automation projects that are reliable, fast, and easy to extend.

Improve test execution time , reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).

Create actionable, engineering-friendly quality dashboards (pass/fail trends, flake rate, coverage, defect escape metrics).

Tooling, CI/CD, and Quality Gates

Integrate automation into CI/CD with quality gates (PR checks, nightly suites, release readiness criteria).

Standardize observability for testing : logs, tracing hooks, screenshots/video, artifacts, and test run diagnostics.

Define practices for test environments , data management, service virtualization, and dependency control.

Technical Leadership & Mentorship

Serve as the QE technical authority: coach engineers on automation design, code quality, and best practices.

Lead design reviews for test architecture and automation PRs; enforce coding standards and maintainability.

Influence roadmap and delivery by translating risk into clear testing priorities.

Required Qualifications
  • 8-12+ years in Quality Engineering / Test Automation with architect-level ownership of frameworks and strategy.
  • Proven experience designing scalable automation across:
    • API testing (contract + integration)
    • UI automation with stable locator strategies (test IDs, accessibility roles)
    • Test data strategy and environment reliability
  • Strong programming skills in at least one modern language (e.g., Java, Python, TypeScript/JavaScript, C# ).
  • Expertise with automation tools/frameworks (examples):
    • UI: Playwright / Cypress / Selenium
    • API: REST-assured / SuperTest / Postman/Newman / pytest
    • CI: GitHub Actions / Jenkins / Azure DevOps
  • Demonstrated ability to reduce flakiness and improve execution speed through engineering solutions .
Preferred Qualifications (Strongly Desired)
  • Experience testing LLM/Agentic AI features or other probabilistic systems, including:
    • evaluation harnesses, benchmark datasets, semantic scoring, and drift detection
    • prompt/version regression strategies and structured evaluation reports
  • Familiarity with modern quality approaches: test pyramid , contract testing , consumer-driven contracts , risk-based testing , shift-left .
  • Knowledge of security/performance testing integration (baseline understanding; hands-on is a plus).
  • Experience building reusable automation libraries for multiple teams/products.
Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we're getting to know you-not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Compensation:

Compensation: $89,600.00 - $157,000.00 USD This role is eligible for Bonus. Compensation range

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Software Test Automation Engineer | Test Architect - Agentic AI
Lead Software Test Automation Engineer | Test Architect - Agentic AI

Wolters Kluwer • Coppell (TX)

Hybrid
USD 89,600 - 157,000
Medical, Dental & Vision Plans
401(k)
Paid Parental Leave
+1
Lead Software Engineer in Test – Agentic AI (Remote - US)
Lead Software Engineer in Test – Agentic AI (Remote - US)

vibehackers • United States

Remote
USD 150,000 - 190,000
Generous annual bonus opportunity
401(k) with employer match
Medical Insurance
+2
Lead QA Engineer for AI & LLM Workflows (Remote)
Lead QA Engineer for AI & LLM Workflows (Remote)

vibehackers • United States

Hybrid
USD 150,000 - 190,000
Generous annual bonus opportunity
401(k) with employer match
Medical Insurance
+2
QA / Automation Engineer Agentic AI
QA / Automation Engineer Agentic AI

Compunnel Inc. • Atlanta (GA)

On-site
USD 110,000 - 160,000
AI/ML Architetc (Agentic AI)
AI/ML Architetc (Agentic AI)

Spanidea Systems • United States

Remote
USD 110,000 - 150,000
Employee assistance program
Health insurance
Professional development assistance
+1
Senior Software Automation Engineer
Senior Software Automation Engineer

C T Corporation System (DE) • Coppell (TX)

On-site
USD 71,000 - 125,000
Medical plans
Dental plans
Vision plans
+6
AI / ML Architect (Agentic AI)
AI / ML Architect (Agentic AI)

Spanidea Systems • United States

Remote
USD 110,000 - 124,000
Dental insurance
Health insurance
Vision insurance
Senior Software Test Automation Engineer
Senior Software Test Automation Engineer

C T Corporation System (DE) • Coppell (TX)

On-site
USD 71,000 - 125,000
Lead AI-Driven Test Automation Architect
Lead AI-Driven Test Automation Architect

C T Corporation System (DE) • Coppell (TX)

On-site
USD 90,000 - 157,000
Senior .NET Test Automation Engineer
Senior .NET Test Automation Engineer

EPAM Systems • United States

Remote
USD 120,000 - 160,000