Automation Architect (AI Testing)

Cognizant; Toronto; Hybrid; CAD 110,000 - 133,000; Full time

Job summary

Cognizant in Toronto, Ontario is seeking an experienced Automation Architect to lead next‑gen quality engineering, translating complex testing challenges into AI/ML and LLM solutions. You will own the automated testing platform, architect scalable frameworks, and collaborate across teams to define testing strategies.

The role emphasizes hybrid work with 4 days in Cognizant offices in Toronto, focusing on AI standards, POCs/POVs, and industrializing AI test approaches.

Qualifications

• 12+ years in software quality engineering and automation.
• Experience designing solutions utilizing LLMs and AI coding assistants.
• Hands-on with agentic workflows and autonomous multi-agent systems.
• Deep expertise in enterprise-grade test automation architecture and CI/CD integration.
• Strong communication and ability to run workshops for executives.

Responsibilities

• Define QE strategy, automation architecture, test environments, tools, and quality gates.
• Translate challenges into AI/ML solutions and select appropriate approaches (ML, LLM, copilot).
• Possibility of building agentic solutions as applicable.
• Define AI standards and best practices with stakeholders.
• Document reusable components and run POCs/POVs; showcase value to leadership.

Skills

Automation architecture

AI integration

LLMs/AI copilots

CI/CD integration

Executive stakeholder comms

Tools

GitHub Copilot

CI/CD tools

Job description

About the role

We are seeking a experienced Automation Architect to spearhead our next-generation quality engineering initiatives. In this role, you will translate complex business and IT testing challenges into cutting-edge AI/ML solutions, Large Language Models (LLMs), AI assistants, and autonomous agentic workflows. The role involves taking ownership of the automated testing platform, architecting scalable test frameworks, and collaborating with various teams to define testing strategies.

In this role, you will

• Define QE strategy, automation architecture, test environments, tools, and quality gates.
• Translate business and IT challenges into AI/ML solutions and choose appropriate approach ( ML, LLM , co-pilot etc.).
• Possibility of building Agentic solutions as applicable.
• Define AI standards and best practices by collaborating with internal as well as external relevant stakeholders.
• Conduct internal workshops.
• Document reusable components.
• Run POC’s and POV’s for emerging trends and show case our value adds in AI space to internal and external leadership.
• Conduct AI/ML hackathons and road shows.

Work model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role's business requirements, this is a hybrid position requiring 4 days a week in a client or Cognizant office in Toronto, ON. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

Note:

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

• 12+ years in software quality engineering and automation, with a dedicated focus on architecture and AI integration.
• Proven experience designing and implementing solutions utilizing LLMs, machine learning models, and AI coding assistants (e.g., GitHub Copilot).
• Hands-on experience or deep familiarity with building agentic workflows and autonomous multi-agent systems.
• Deep expertise in enterprise-grade test automation framework design, CI/CD integration, and scalable test architecture.
• Exceptional communication and presentation skills, with a track record of running POCs/POVs, conducting technical workshops, and engaging executive stakeholders.

These will help you stand out

• Familiarity with vector databases, embedding models, and MLOps pipelines supporting AI testing platforms.
• Banking Domain experience.

We're excited to meet people who share our mission and can make an impact in a variety of ways. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.

Total compensation

We regularly assess market data to ensure we offer a competitive compensation package for our associates. The base salary for this position ranges between 110,000 - 133,000 per year. Where the successful candidate may fall within the range depends on relevant education, work and/or management experience and other business-related and job-necessary qualifications. This position is also eligible for Cognizant's discretionary annual performance-based bonus, as well as benefits that support your physical, mental and financial wellbeing.