Senior Quality Automation Engineer – AI/LLM

Accenture PLC; Monterrey; Hybrid; MXN 600,000 - 900,000; Full time

Benefits offered by this job

Career development

Innovative tools & methodologies

Direct contact with global experts

Ongoing training and skill growth

Collaborative team environment

International projects

Job summary

Accenture is seeking an experienced Senior Quality Automation Engineer – AI/LLM to join a collaborative team in Monterrey. You will work with Product, Engineering, Architecture, and Business SMEs to define measurable quality criteria, build automated testing and evaluation suites, and provide independent evidence to support release-readiness decisions in AI-driven environments.

Ideal candidates have 6+ years in Quality Engineering with hands-on Playwright, TypeScript/JavaScript, Python pytest,

Qualifications

• 6+ years of experience in Software Quality Engineering, SDET, or Test Automation.
• 2+ years of hands-on Playwright experience.
• Strong TypeScript or JavaScript skills.
• Hands-on experience with Python test automation and pytest or comparable frameworks.
• Practical experience testing LLM, RAG, conversational AI, or agent-based solutions.
• Experience with REST APIs, JSON, OpenAPI, UI/API automation, and service integrations.
• Experience integrating automated tests into CI/CD pipelines, preferably Azure DevOps.
• Experience with Git-based development workflows.
• Knowledge of AI-specific failure modes such as hallucination, grounding failure, prompt injection, unsafe tool use, and retrieval or permission defects.
• Ability to translate requirements into risk-based test scenarios and traceable quality evidence.
• Experience collaborating with Developers, Architects, Product Owners, and Business SMEs to investigate failures and provide release recommendations.
• Strong written and verbal communication skills.

Responsibilities

• Define measurable quality criteria for AI-enabled solutions and establish traceable quality evidence.
• Build automated testing and evaluation suites for LLM, RAG, and conversational AI features.
• Provide independent evidence to support release-readiness decisions and risk-based testing.
• Collaborate with Product, Engineering, Architecture, and SMEs to investigate failures and propose release recommendations.

Skills

Playwright

JavaScript

Python

AI/LLM testing

REST APIs

CI/CD

Git

Communication

Testing strategy

Tools

Azure DevOps

OpenAPI

Git

Job description

DARE TO BE A PART OF THE CHALLENGE! COME AND JOIN OUR TEAM TOGETHER WE CAN MAKE THE DIFFERENCE! Did you know that Accenture is leading the digital transformation in the World? Accenture is a leading global professional services company, providing a broad range of services and solutions in strategy, consulting, digital, technology and operations. Our main purpose is to collaborate with our clients, so they can become high-performance businesses. Accenture is present in more than 200 offices, 120 cities, 56 countries and approximately 743,000 employees worldwide.

Offer

• Career development according to your profile and interests.
• Work in one of the best companies and feel proud.
• Access to an innovative methodology and tools.
• Direct contact with experts worldwide.
• Use of work schemes and cutting-edge technologies.
• Constant training.
• Work environment based on teamwork and collaboration.
• Participation in International Projects

We are looking for an experienced Senior Quality Automation Engineer – AI/LLM to join a collaborative team working on modern AI-enabled solutions. This role will partner closely with Product, Engineering, Architecture, and Business Subject Matter Experts to define measurable quality criteria, build automated testing and evaluation suites, and provide independent evidence to support release-readiness decisions. The ideal candidate has a strong background in quality engineering and test automation, along with practical experience testing LLM, RAG, conversational AI, or agent-based solutions. Deep expertise in every AI evaluation tool is not required; we are looking for someone with solid automation fundamentals who can apply them effectively in AI-driven environments.

Required Qualifications

• 6+ years of experience in Software Quality Engineering, SDET, or Test Automation.
• 2+ years of hands-on Playwright experience.
• Strong TypeScript or JavaScript skills.
• Hands-on experience with Python test automation and pytest or comparable frameworks.
• Practical experience testing LLM, RAG, conversational AI, or agent-based solutions.
• Experience with REST APIs, JSON, OpenAPI, UI/API automation, and service integrations.
• Experience integrating automated tests into CI/CD pipelines, preferably Azure DevOps.
• Experience with Git-based development workflows.
• Knowledge of AI-specific failure modes such as hallucination, grounding failure, prompt injection, unsafe tool use, and retrieval or permission defects.
• Ability to translate requirements and acceptance criteria into risk-based test scenarios and traceable quality evidence.
• Experience collaborating with Developers, Architects, Product Owners, and Business SMEs to investigate failures and provide release recommendations.
• Strong written and verbal communication skills.

Location: Monterrey Work model: Hybrid, with at least 3 days per week in the office.

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships.

We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities. Visit us at www.accenture.com

Declaración de igualdad de oportunidades en el empleo Creemos que nadie debe ser discriminado por sus diferencias. Todas las decisiones de empleo se tomarán sin importar la edad, raza, credo, color, religión, sexo, origen nacional, ascendencia, discapacidad, condición de veterano militar, orientación sexual, identidad o expresión de género, información genética, estado civil, ciudadanía ni ningún otro criterio protegido por la legislación aplicable. Nuestra rica diversidad nos hace más innovadores, competitivos y creativos, lo que nos ayuda a servir mejor a nuestros clientes y comunidades.

Bring your incredible skills and join our global team of innovators. We come together from different backgrounds across the world and work with the latest technologies to create value and growth for our clients. With us, you’ll continue to learn and grow so you can advance in your career. Your personal dreams and ambitions are just as important to us; that’s why we offer support any way we can—when you thrive, we all thrive. Explore your next step at Accenture Belong. Grow. Thrive. Join a great place to work for reinventors who drive meaningful change for our clients, communities, and the world. Wo rld. Explore your next step at Accenture