Senior Test Architect – AI Platform Test Strategy, Technologies and Execution IRC306523

GlobalLogic Inc.; India; On-site; INR 3,500,000 - 7,500,000; Full time

Benefits offered by this job

Flexible work schedules

Work from home options

Excellent Benefits

Remote-friendly environment

Professional development

Job summary

GlobalLogic Inc. in Noida, India, seeks a Senior Test Architect/Consultant to lead quality engineering for AI-driven platforms and autonomous agents. You will design end-to-end test strategies, evaluate modern tools, and ensure data security and multi-tenant isolation across testing environments.

You will guide cross-functional teams including developers, data scientists, and security professionals, establishing shift-left principles and robust QA governance across CI/CD pipelines.

Qualifications

• 10+ years of progressive experience in Quality Engineering, Test Architecture, or QA Consulting.
• Proven track record in designing enterprise-level test strategies and master test plans.
• Recent hands-on experience testing AI models, LLMs, or intelligent autonomous agents.
• AI & Agent Testing: testing contextual accuracy, prompt injection vulnerabilities, RAG architectures, and non-deterministic outcomes.
• Test Automation: proficiency with Playwright, Cypress, Selenium and API testing tools.
• Performance & Security: experience with JMeter, Gatling, k6 and OWASP Top 10.

Responsibilities

• Design and author end-to-end test strategies and plans covering functional, non-functional, security, and performance concerns for complex AI-driven systems.
• Develop methodologies to test agentic behaviors and edge cases including hallucinations and contextual relevance.
• Architect test data strategies, including synthetic data and strict data separation in testing and LLM contexts.
• Evaluate tools and build custom test harnesses and sandboxes for agents and APIs.
• Oversee automation pipelines, drive performance testing and security testing to ensure reliability.
• Collaborate with developers, data scientists, product managers, and security teams to embed quality early in the SDLC.

Skills

Agentic & Multi-Agent Systems

Performance testing/tuning

Security testing

Testing Strategies & Test Architecture

Tools

Playwright

Cypress

Selenium

Postman

REST Assured

Job description

Senior Test Architect – AI Platform Test Strategy, Technologies and Execution IRC306523

Function: IT, Telecom & Internet

Experience: 15+ years

Location: India - Noida

Skills: Agentic & Multi-Agent Systems, Performance testing/tuning, Security testing, Testing Strategies & Test Architecture for Web

About the Role
We are seeking a highly experienced Senior Test Architect/Consultant to lead the quality engineering strategy for our next-generation applications, with a heavy emphasis on intelligent agents, AI-driven workflows, and complex data ecosystems. In this role, you will bridge the gap between traditional quality assurance (automation, performance, security) and cutting-edge AI validation.

You will be responsible for designing comprehensive test strategies that address both functional and non-functional requirements (NFRs). Your mandate includes evaluating emerging test tools, building robust test harnesses, and ensuring the contextual accuracy, data security, and operational reliability of our AI agents and core platforms.

Key Responsibilities
Test Strategy & Planning: Design and author end-to-end test strategies and test plans covering all architectural concerns (functional, non-functional, security, and performance) for complex systems, specifically focusing on autonomous agents and AI-driven platforms.

AI Agent & Outcome Validation: Develop methodologies to test agentic behaviors, ensuring the accuracy of outcomes, contextual relevance of responses, and proper handling of edge cases/hallucinations.

Test Data Engineering: Architect strategies for test data creation, management, and synthetic data generation. Ensure rigorous data security, privacy compliance, and strict multi-tenant data separation within testing environments and LLM contexts.

Tool Evaluation & Harness Development: Continuously evaluate and onboard modern testing tools and frameworks. Build custom test harnesses and sandboxes specifically designed to interact with and evaluate intelligent agents and APIs.

Automation, Performance, & Security: Oversee the architecture of traditional test automation pipelines. Drive performance testing (load, stress, scalability) and security testing (vulnerability scanning, penetration testing integrations) to ensure enterprise-grade reliability.

Cross-Functional Leadership: Act as a consultant and technical leader, collaborating closely with developers, data scientists, product managers, and security teams to embed quality engineering principles early in the software development lifecycle (Shift-Left).

Required Qualifications
Experience & Background:

10+ years of progressive experience in Quality Engineering, Test Architecture, or QA Consulting.

Proven track record in designing and implementing enterprise-level test strategies and master test plans from scratch.

Recent hands-on experience testing AI models, LLMs, or intelligent autonomous agents.

AI & Agent Testing: Deep understanding of testing methodologies for contextual accuracy, prompt injection vulnerabilities, RAG (Retrieval-Augmented Generation) architectures, and non-deterministic outcomes.

Test Automation: Expert-level proficiency with modern test automation frameworks (e.g., Playwright, Cypress, Selenium) and API testing tools (Postman, REST Assured).

Performance & Security: Strong background in performance engineering (JMeter, Gatling, k6) and security testing concepts (OWASP Top 10, SAST/DAST, data masking).

Test Data Management: Expertise in formulating robust test data strategies, including synthetic data generation and enforcing strict data separation/privacy protocols.

Architecture & CI/CD: Ability to architect custom test harnesses and integrate automated quality gates into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).

Preferred Skills
Familiarity with LLM evaluation frameworks (e.g., LangSmith, TruLens, Ragas, promptfoo).

Experience in cloud-native environments (AWS, Azure, or GCP) and containerized applications (Docker, Kubernetes).

Strong programming skills in Python, Java, or Node.js.

Job responsibilities

About the Role
We are seeking a highly experienced Senior Test Architect/Consultant to lead the quality engineering strategy for our next-generation applications, with a heavy emphasis on intelligent agents, AI-driven workflows, and complex data ecosystems. In this role, you will bridge the gap between traditional quality assurance (automation, performance, security) and cutting-edge AI validation.

You will be responsible for designing comprehensive test strategies that address both functional and non-functional requirements (NFRs). Your mandate includes evaluating emerging test tools, building robust test harnesses, and ensuring the contextual accuracy, data security, and operational reliability of our AI agents and core platforms.

Key Responsibilities
Test Strategy & Planning: Design and author end-to-end test strategies and test plans covering all architectural concerns (functional, non-functional, security, and performance) for complex systems, specifically focusing on autonomous agents and AI-driven platforms.

AI Agent & Outcome Validation: Develop methodologies to test agentic behaviors, ensuring the accuracy of outcomes, contextual relevance of responses, and proper handling of edge cases/hallucinations.

Test Data Engineering: Architect strategies for test data creation, management, and synthetic data generation. Ensure rigorous data security, privacy compliance, and strict multi-tenant data separation within testing environments and LLM contexts.

Tool Evaluation & Harness Development: Continuously evaluate and onboard modern testing tools and frameworks. Build custom test harnesses and sandboxes specifically designed to interact with and evaluate intelligent agents and APIs.

Automation, Performance, & Security: Oversee the architecture of traditional test automation pipelines. Drive performance testing (load, stress, scalability) and security testing (vulnerability scanning, penetration testing integrations) to ensure enterprise-grade reliability.

Cross-Functional Leadership: Act as a consultant and technical leader, collaborating closely with developers, data scientists, product managers, and security teams to embed quality engineering principles early in the software development lifecycle (Shift-Left).

Required Qualifications
Experience & Background:

10+ years of progressive experience in Quality Engineering, Test Architecture, or QA Consulting.

Proven track record in designing and implementing enterprise-level test strategies and master test plans from scratch.

Recent hands-on experience testing AI models, LLMs, or intelligent autonomous agents.

AI & Agent Testing: Deep understanding of testing methodologies for contextual accuracy, prompt injection vulnerabilities, RAG (Retrieval-Augmented Generation) architectures, and non-deterministic outcomes.

Test Automation: Expert-level proficiency with modern test automation frameworks (e.g., Playwright, Cypress, Selenium) and API testing tools (Postman, REST Assured).

Performance & Security: Strong background in performance engineering (JMeter, Gatling, k6) and security testing concepts (OWASP Top 10, SAST/DAST, data masking).

Test Data Management: Expertise in formulating robust test data strategies, including synthetic data generation and enforcing strict data separation/privacy protocols.

Architecture & CI/CD: Ability to architect custom test harnesses and integrate automated quality gates into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).

Preferred Skills
Familiarity with LLM evaluation frameworks (e.g., LangSmith, TruLens, Ragas, promptfoo).

Experience in cloud-native environments (AWS, Azure, or GCP) and containerized applications (Docker, Kubernetes).

Strong programming skills in Python, Java, or Node.js.

What we offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.

Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.

• Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.

• Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.