Senior AI-Driven QA Automation Architect

CFA Institute; United States; Hybrid; USD 120,000 - 160,000; Full time

Job summary

CFA Institute seeks a Senior Quality Engineering Architect to lead test automation and AI-enabled quality engineering across platforms. You will shape technical strategy, evaluate new tech, and build scalable solutions that elevate software quality while advancing engineering excellence.

The role includes designing governance for AI-enabled QE, mentoring automation engineers, and collaborating with DevSecOps, platform, and product teams. Remote/hybrid options apply.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 10+ years of experience in software quality engineering, with deep technical individual-contributor track experience.
• Proven framework architect with a track record of designing and shipping enterprise-grade Playwright/TypeScript automation frameworks adopted by multiple teams.
• Hands-on technical depth across UI, API, mobile, intelligent test execution, performance, and accessibility testing.
• Strong AI fluency — LLM-assisted test generation, AI model quality evaluation, prompt engineering, agentic workflows, RAG and MCP concepts.

Responsibilities

• Design and govern enterprise-grade Playwright/TypeScript automation frameworks — page objects, fixtures, reporters, CI integration, and intelligent test execution.
• Evaluate test automation frameworks, tools, and patterns; make build-vs-buy recommendations and drive consistency across teams.
• Lead proof-of-concepts for AI-driven test generation, autonomous test maintenance, intelligent defect triage, and agentic testing; translate experiments into production-grade adoption playbooks.
• Design AI integration points across the QE stack — self-healing locators, prompt-driven test generation, LLM evaluation pipelines (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard), and RAG/MCP for test data and tooling.
• Serve as the senior technical voice that engineers elevate to for framework, architecture, and tooling decisions; resolve technical debt at the architectural level.
• Mentor automation engineers across all levels; run technical brown bags, code reviews, and capability-building sessions.
• Provide technical oversight and quality assurance for work delivered by a mix of full-time engineers and managed-service contractors.
• Partner with engineering, DevSecOps, platform, and product teams to embed quality at the architectural layer.
• Establish responsible AI governance for AI-led QE practices, including evaluation standards, prompt-quality criteria, and model-output reliability.

Skills

Playwright/TypeScript automation

AI fluency

Test automation

Framework architecture

Mentoring/leadership

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Ragas

DeepEval

Promptfoo

LangSmith

Giskard

Job description

CFA Institute seeks a Senior Quality Engineering Architect to lead test automation and AI-enabled quality engineering across platforms. You will shape technical strategy, evaluate new tech, and build scalable solutions that elevate software quality while advancing engineering excellence.

The role includes designing governance for AI-enabled QE, mentoring automation engineers, and collaborating with DevSecOps, platform, and product teams. Remote/hybrid options apply.