Test Engineer

Persistent; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Competitive salary

Talent development programs

Cutting-edge tech

Employee engagement events

Health check-ups

Insurance coverage

Job summary

Persistent is seeking an AI Test Engineer to validate AI-powered applications across the software lifecycle in Bangalore. The role emphasizes testing AI/Generative AI, LLM outputs, prompt workflows, and automated frameworks.

You will collaborate with AI engineers and product teams to ensure robust quality gates, drive comprehensive test coverage, and manage AI validation datasets while supporting CI/CD pipelines.

Qualifications

• Experience in manual and automated testing across AI-enabled applications.
• Hands-on testing of AI/Generative AI systems and prompt validation.
• Knowledge of LLMs, AI model behavior, and risk assessment.
• Experience integrating testing into CI/CD pipelines.

Responsibilities

• Design and execute test strategies for Generative AI and Agentic AI apps.
• Validate LLM outputs for accuracy, safety, bias, and hallucinations.
• Test prompt versions and assess behavior changes across model updates.
• Develop and maintain automated test frameworks for AI-enabled apps.
• Execute functional, regression, integration, performance, and non-functional testing.
• Test AI integrations, APIs, workflows, and external service connections.
• Perform regression testing for AI model updates and prompt changes.
• Collaborate with developers, AI engineers, and product teams to enforce quality gates.
• Create and manage test datasets for AI validation and benchmarking.
• Monitor AI app performance and identify risks like model drift.
• Support CI/CD quality gates and automated validation pipelines.

Skills

Manual Testing

Automation Testing

AI Testing

LLM Testing

Prompt Testing

CI/CD

Agile/Scrum

Selenium

Playwright

API Testing

Tools

Selenium

Playwright

Postman

REST Assured

Job description

About Position:

We are seeking an AI Test Engineer with 8-14 years of experience in Software Testing, Test Automation, and AI/Generative AI validation. The ideal candidate will be responsible for ensuring the quality, reliability, safety, and correctness of AI-powered applications across the software development lifecycle. This role requires expertise in testing Large Language Models (LLMs), Agentic AI solutions, prompt engineering workflows, AI integrations, and automated testing frameworks.

• Role: Test Engineer
• Location: Bangalore
• Experience: 8 to 14 years
• Job Type: Full Time Employment

What You'll Do:

• Design and execute comprehensive test strategies for Generative AI and Agentic AI applications.
• Validate LLM outputs for accuracy, bias, hallucinations, safety, and consistency.
• Test prompt versions and evaluate AI behavior changes across model updates.
• Develop and maintain automated test frameworks for AI-enabled applications.
• Execute functional, regression, integration, performance, and non-functional testing.
• Test AI integrations, APIs, workflows, and external service connections.
• Perform regression testing for AI model updates, prompt changes, and version upgrades.
• Collaborate with developers, AI engineers, and product teams to establish quality gates.
• Create and manage test datasets for AI validation and benchmarking.
• Monitor AI application performance and identify risks related to model drift and output quality.
• Support CI/CD quality gates and automated validation pipeline

Expertise You'll Bring:

• Strong experience in Manual and Automation Testing.
• Hands-on experience with AI/Generative AI testing.
• Strong understanding of Large Language Models (LLMs) and AI application behavior.
• Experience validating AI outputs for accuracy, safety, bias, and hallucinations.
• Knowledge of Agentic AI systems and workflow testing.
• Experience with Selenium and Playwright automation frameworks.
• Strong API testing experience using tools such as Postman, REST Assured, or equivalent.
• Understanding of model variability, non-deterministic outputs, and AI evaluation methods.
• Experience with AI prompt testing and prompt optimization validation.
• Strong knowledge of test data management practices for AI systems.
• Familiarity with Responsible AI principles and AI risk assessment.
• Experience integrating testing into CI/CD pipelines.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder collaboration capabilities.
• Experience working in Agile/Scrum environments.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."