AI Quality Architect

EPAM Systems; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

EPAM Systems Inc is seeking an AI Quality Architect to own customer objectives and technical requirements, design full-cycle QA infrastructure, and determine the components for the product. You will build proofs of concept, engage in pre-sales activities, consult with clients, and audit existing solutions for enhancements.

Responsibilities include designing large-scale QA architectures, collaborating with stakeholders, and driving AI-powered QA through GenAI, LLMs, and AI agents to boost test

Qualifications

• 10+ years of IT experience in QA or testing environments.
• Proven Automation Architect experience leading architectures.
• Experience with GenAI tools and AI/ML testing.
• Proficiency in Java, C#, or Python.
• Familiarity with JavaScript/TypeScript.

Responsibilities

• Design large-scale QA solutions with in-depth technical detail.
• Collaborate with business stakeholders to determine requirements.
• Define and execute comprehensive test automation strategies and roadmaps.
• Build and maintain QA frameworks and shared formats for programs.
• Guide architecture frameworks for test automation across projects.
• Track key quality metrics like defect density and test coverage.
• Lead continuous improvement of test processes and tools for digital transformation.
• Participate in pre-sales activities such as proposals and demos.

Skills

Automation Architect

GenAI tools

Java/C#/Python

JavaScript/TypeScript

Leadership in Architecture

Tools

DeepEval

Ragas

Job description

We're seeking an AI Quality Architect to take ownership of customers' business objectives and technical requirements, design full-cycle project infrastructure, and determine the components that will make up the product. This position suits individuals passionate about engineering solutions and technologies, offering opportunities to build proofs of concept, engage in pre-sales activities, provide client consultations, and audit existing solutions to assess their effectiveness and identify areas for enhancement.

Responsibilities

• Design large-scale solutions with in-depth technical detail
• Collaborate closely with business stakeholders to determine project requirements
• Design QA solutions that are maintainable, extensible, modular, and aligned with industry best practices (SOLID principles, design patterns, etc) for implementation by project or program teams
• Build and maintain QA frameworks, solutions, and shared formats usable across all company projects and programs
• Define and execute comprehensive test automation strategies, including roadmaps, tools, frameworks, and approaches
• Develop and maintain documentation covering automation processes, workflows, and configurations
• Assess and choose the most suitable test automation tools for various purposes
• Guide the definition, selection, and expansion of test automation architecture frameworks
• Track and report key quality metrics, including defect density, test coverage, and release cycle times across manual, automated, and performance testing
• Supervise manual and automated testing efforts to validate functional, integration, regression, and performance aspects
• Drive the adoption and implementation of AI-powered solutions in Quality Engineering processes, leveraging GenAI, LLMs, and AI agents to enhance test automation, test generation, test data management, defect analysis, and overall software quality
• Lead continuous improvement initiatives in test processes, tools, and techniques to support digital transformation
• Conduct architecture reviews and audits
• Determine project requirements and goals needed to achieve a go-live solution
• Participate hands-on in pre-sales activities such as proposals, RFPs, RFIs, and demos
• Maintain direct communication with customers throughout solution architecture design and implementation

Requirements

• 10+ years of IT experience
• Experience in Quality Engineering or Test Automation, with proven experience acting as an Automation Architect
• Knowledge of GenAI tools, testing AI/ML-based systems, using LLMs, MCPs, and RAG, and evaluating AI agents through tools such as DeepEval and Ragas
• Proficiency in at least one programming or scripting language, preferably Java, C# NET, or Python
• Familiarity with JavaScript and TypeScript
• Strong grasp of industry trends and best practices
• Proactive mindset and leadership skills in architecture engagements