QA Engineer

Lyzr AI; Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Zomato meal allowance

Extensive PTO policy

Subscriptions to leading AI tools

Hybrid structure

Job summary

Lyzr is seeking a Quality Owner for the Applied AI pod. You will shape test strategy, automation, and evaluation for AI agent applications, ensuring robust end-to-end quality across REST APIs, prompts, and LLM-powered systems.

Bring 2–5 years of experience, proficiency in TypeScript or Python, and hands-on API testing with Postman. Hybrid work enables collaboration and focused coding time.

Qualifications

• You test AI applications from the builder’s side and have built AI-based applications.
• TypeScript or Python proficiency; test tooling and harnesses here are written in code.
• API testing expertise with REST APIs using tools such as Postman.
• AI/LLM testing experience with prompts, agents, RAG pipelines, evaluations.
• Ability to handle multiple client engagements and propose fixes, not just report issues.

Responsibilities

• Own quality end-to-end for your pod—test strategy, automation, API testing, and evaluation of LLM-based systems.
• Define and implement test plans and harnesses for agent applications.
• Collaborate with engineers and product to improve test coverage and release quality.

Skills

TypeScript

Python

API testing

AI/LLM testing

Parallel projects

Tools

Postman

Playwright

Selenium

Job description

Lyzr, in a minute

Lyzr is an enterprise software company that helps large organisations put AI agents — software that handles real tasks on its own — to work in their everyday operations. Most companies’ AI projects never move past the pilot stage; Lyzr provides the platform that takes them into dependable, day-to-day use. Today, 500+ enterprises build on Lyzr, more than 1,000 agents run live in production, and 85% of Lyzr projects reach production against an industry average of roughly 30%. Customers include Accenture, WTW, Hitachi, and Verifone, and the company recently raised $100M at a $500M valuation.

The Applied AI team is where this becomes real for customers — and nothing ships from there unless the quality holds. That is where this role comes in.

The role

• Team: Applied AI
• Experience: 2–5 years

Lyzr, in a minute

Lyzr is an enterprise software company that helps large organisations put AI agents — software that handles real tasks on its own — to work in their everyday operations. Most companies’ AI projects never move past the pilot stage; Lyzr provides the platform that takes them into dependable, day-to-day use. Today, 500+ enterprises build on Lyzr, more than 1,000 agents run live in production, and 85% of Lyzr projects reach production against an industry average of roughly 30%. Customers include Accenture, WTW, Hitachi, and Verifone, and the company recently raised $100M at a $500M valuation.

The Applied AI team is where this becomes real for customers — and nothing ships from there unless the quality holds. That is where this role comes in.

The role

Our Applied AI pods build agent applications for enterprise customers, and each pod needs a dedicated quality owner. Testing AI agents is a discipline of its own: these systems are non-deterministic by design, and evaluating them requires new strategies beyond conventional QA. You will own quality end-to-end for your pod — test strategy, automation, API-level testing, and the evaluation of LLM-based systems — and help define how agent testing is done at Lyzr.

• Team: Applied AI
• Experience: 2–5 years
• Work mode: Hybrid

What Will Make You Win This Role

These are the core requirements — the substance of the job.

• You test AI applications from the builder’s side. You have built AI-based applications yourself, which shapes how you find their weaknesses as a tester.
• TypeScript or Python proficiency. Test tooling, scripts, and harnesses here are written in code, and you should be comfortable writing it.
• API testing expertise. Strong, hands-on experience testing REST APIs with tools such as Postman.
• AI/LLM testing experience. You have tested LLM-powered systems — prompts, agents, RAG pipelines, evaluations. A strong theoretical foundation is acceptable, provided you can demonstrate it in our assessment rounds.
• You work well across parallel projects. Multiple client engagements, frequent context switching, and a solutioning mindset — proposing the fix, not only reporting the issue — are baseline expectations in this role.

Cherry on top

Not screening criteria — but they will make your first 90 days smoother.

• Playwright or Selenium. Hands-on experience with automation frameworks deepens your technical insight and shortens your ramp into the role.

Life at Lyzr

• Benefits. Zomato meal allowance, an extensive PTO policy, and company-paid subscriptions to leading AI tools — you work with the same tooling our customers rely on.
• Hybrid structure. Office days for collaboration and team problem-solving; remote days for deep, uninterrupted work.
• An exceptional team. You will work alongside genuinely strong engineers and operators — the kind of colleagues who raise the level of everyone around them.
• Autonomy and ownership. We hire people who think like founders. You are given a problem and the space to drive your own outcomes — and with them, your own growth.
• Everybody is a visionary. Ideas are evaluated on merit, not seniority. You lead projects, make decisions, and shape what Lyzr becomes.