AI Quality Architect: Testing & GenAI Solutions

TEKsystems; Austin (TX); Remote; USD 128,000 - 192,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k) Retirement Plan

Life Insurance

Disability Coverage

HSA

Job summary

TEKsystems seeks a Senior Practice Architect to lead AI-driven quality engineering across client engagements in Austin. You will architect test strategies for traditional and AI-enabled systems, including ML models, GenAI, LLMs, and RAG, applying AI to transform testing design and governance.

In this senior, client-facing role, you will shape solutions, create reusable accelerators, guide delivery teams, and advise on trustworthy AI adoption.

Qualifications

• 10+ years in software development or quality engineering, incl. 3+ years in an architect role at a tech organization.
• Proven track record designing enterprise test strategies and automation architectures from scratch using Java, Python, or JavaScript/TypeScript.
• Hands-on experience designing and executing testing strategies for AI/ML and GenAI systems, with understanding of drift, bias, hallucination, and security.
• Expertise with open-source and commercial AI models, copilots, prompt engineering, and agentic AI for testing solutions or accelerators.
• Strong knowledge of UI and API automation (Playwright, Selenium, Rest Assured, Karate), CI/CD, and cloud platforms (AWS, Azure, GCP).
• Experience shaping Statements of Work, proposals, and estimates in a consulting or client-facing environment.
• Excellent communication, presentation, and executive stakeholder skills; able to explain AI risk and quality trade-offs to technical and business audiences.
• Bachelor’s degree or equivalent experience in CS or related field.
• Ability to travel to the United States or Canada.

Responsibilities

• Architect end-to-end quality engineering solutions and reference architectures for enterprise applications, data platforms, and AI-enabled systems.
• Provide architectural direction across engagements; review designs, set standards, and ensure solutions are scalable, secure, and maintainable.
• Evaluate and recommend tools, platforms, and AI models based on fit, cost, risk, security, and client constraints.
• Grow the CQ practice by identifying improvement opportunities, defining best practices, and documenting reusable patterns.
• AI Quality Engineering: design testing methodologies for deterministic and non-deterministic systems, data quality and lineage, model behavior and performance, bias, fairness, explainability, drift, robustness, and security.
• Define evaluation approaches for GenAI, RAG, and agentic systems, including datasets, rubric-based scoring, groundedness, hallucination, prompt injection, and tool-use validation.
• Embed AI quality gates into CI/CD and MLOps/LLMOps workflows, with production monitoring, observability, and drift detection.
• Lead client workshops, AI quality assessments, solution design, demos, proofs of concept, and proposals with clear assumptions and scope boundaries.

Skills

Java

Python

JavaScript/TypeScript

UI automation

API automation

CI/CD

Cloud platforms

AI/GenAI testing

Architect

Test strategies

Education

Bachelor's degree in Computer Science or related field

Tools

Playwright

Selenium

Rest Assured

Karate

Job description

TEKsystems seeks a Senior Practice Architect to lead AI-driven quality engineering across client engagements in Austin. You will architect test strategies for traditional and AI-enabled systems, including ML models, GenAI, LLMs, and RAG, applying AI to transform testing design and governance.

In this senior, client-facing role, you will shape solutions, create reusable accelerators, guide delivery teams, and advise on trustworthy AI adoption.