Test Automation Architect (Gen AI, Playwright, Selenium)

Happiest Minds; Bengaluru; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

Happiest Minds is seeking an experienced Automation Test Architect to lead the Quality Engineering strategy for GenAI-driven systems in Bengaluru. The role demands 14+ years of expertise in testing and quality leadership, focusing on defining test architectures and automation frameworks.

You will drive shift-left quality practices, mentor teams, and ensure enterprise-grade quality for AI agents and data pipelines. This full-time position offers a chance to work at the forefront of technology while promoting quality outcomes aligned with business expectations.

Qualifications

• Proven experience as a Test Architect / Automation Architect / QE Lead.
• Strong background in enterprise-scale automation and test strategy.
• Experience testing GenAI systems, LLMs, or AI agents is highly preferred.

Responsibilities

• Define and lead the QE strategy for GenAI initiatives.
• Design and implement test architectures and automation frameworks.
• Mentor and guide QA/QE teams.
• Ensure compliance with regulatory and enterprise quality standards.

Skills

Selenium

Playwright

Automation

API testing

Microservices architectures

Education

14+ years of experience in software testing and quality engineering

Tools

CI/CD tools

Postman

JMeter

Job description

Job Description

Automation Test Architect

Role Summary

We are seeking an experienced Automation Test Architect to lead the Quality Engineering (QE) strategy for GenAI-driven systems. The ideal candidate will have 14+ years of experience in testing and quality leadership, with strong expertise in defining test architectures, building scalable automation frameworks, and ensuring enterprise-grade quality for AI agents, LLM workflows, APIs, and data pipelines. This role requires a strategic leader who can drive shift-left quality practices, mentor teams, and align quality outcomes with business and regulatory expectations.

Key Responsibilities

• Quality Engineering Strategy & Leadership
  • Define and lead the QE strategy for GenAI initiatives, ensuring reliability, scalability, and regulatory compliance.
  • Establish quality standards, test governance, and quality gates across the SDLC.
  • Drive shift-left testing practices and continuous quality improvements.
  • Mentor and guide QA/QE teams, building strong automation and AI testing capabilities.
• Test Architecture & Automation
  • Design and implement test architectures and automation frameworks for:
    • AI agents and LLM workflows
    • Prompt orchestration and grounding pipelines
    • Data pipelines and API integrations
  • Build and maintain scalable automation suites using:
    • Selenium (mandatory)
    • Python-based frameworks (PyTest optional)
    • Postman, JMeter
    • CI/CD tools for continuous testing
  • Develop reusable test assets to improve efficiency and coverage.
• GenAI Validation & Quality Assurance
  • Design and execute validation strategies for:
    • Model outputs
    • Prompt accuracy and consistency
    • Grounding, reliability, and response quality
  • Implement performance, security, resilience, and reliability testing to ensure production-grade GenAI solutions.
  • Promote AI-assisted testing, synthetic data generation, and observability-driven quality insights.
• Collaboration & Stakeholder Engagement
  • Work closely with:
    • Solution architects
    • Product teams
    • Engineering and platform teams
  • Ensure high-quality releases through early risk identification and measurable quality KPIs.
  • Provide quality inputs during design, architecture reviews, and release planning.
• Governance, Compliance & Metrics
  • Ensure compliance with regulatory and enterprise quality standards.
  • Maintain test documentation and support audit readiness.
  • Define, track, and report quality KPIs, ROI, and risk metrics.
  • Align testing strategies with:
    • Business risk
    • Regulatory expectations
    • Customer impact

Required Experience & Skills

Experience

• 14+ years of experience in software testing and quality engineering
• Proven experience as a Test Architect / Automation Architect / QE Lead
• Strong background in enterprise-scale automation and test strategy

Technical Skills

• Mandatory: Selenium, Playwright, Automation
• Hands-on knowledge of:
  • API and microservices architectures
  • Data pipeline testing
  • Cloud-based systems and enterprise platforms

GenAI & Advanced Testing (Highly Preferred)

• Experience testing GenAI systems, LLMs, or AI agents
• Understanding of:
  • Prompt workflows
  • Model validation techniques
  • Grounding and hallucination risks
• Exposure to AI-assisted testing tools and synthetic data strategies

Job Classification

Industry: IT Services & Consulting

Functional Area / Department: Engineering - Software & QA

Role Category: Software Development

Role: Automation Architect

Employment Type: Full time

Contact Details

Company: Happiest Minds

Location(s): Bengaluru

Ability to work in a team environment with members of varying skill levels. Highly motivated. Learns quickly.