Senior QA Engineer. - Pre Built AIC

Leena AI; Gurugram District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Leena AI in New York is seeking a Senior QA Engineer to validate pre-built AI Colleagues such as Universal HR Assistant, IT Assistant, and Finance Assistant. You will test enterprise AI-powered automation across user intents, knowledge retrieval, and secure workflows.

You will collaborate with Product, Engineering, Solutions, Customer Success, and Implementation teams to ensure accuracy, safety, reliability, and launch readiness across multiple customer environments.

Qualifications

• 4–8 years of QA experience in enterprise SaaS and B2B software.
• Experience testing complex enterprise workflows and third-party integrations.
• Hands-on API testing with Postman, REST Assured, Karate, or similar.
• Test automation with Playwright, Cypress, Selenium, or equivalents.
• Understanding of backend systems, APIs, databases, logs, and webhooks.
• Ability to debug using logs, API responses, DB queries, and monitoring tools.
• Strong test design across functional, negative, edge-case, and RBAC roles.
• Product mindset focused on customer outcomes and end-to-end quality.

Responsibilities

• Own end-to-end QA for pre-built AI Colleague use cases across HR, IT, Finance.
• Validate employee journeys and multi-step workflows.
• Test enterprise integrations, APIs, authentication, data mapping, error handling, permissions, workflow execution.
• Evaluate AI/LLM behavior, including intent understanding, knowledge retrieval, response accuracy.
• Design test scenarios covering happy paths, edge cases, ambiguous queries, and failure scenarios.
• Build and maintain automated regression suites across UI, APIs, integrations, and backend workflows.
• Drive release readiness through CI/CD quality gates, production issue analysis, and regression testing.
• Validate enterprise readiness across security, tenant isolation, access controls, privacy, reliability, and performance.
• Partner with Engineering and Implementation teams to debug issues, improve testability, and support customer UAT.

Skills

QA experience

Enterprise SaaS

Test design

API testing

Test automation

Debugging

Product mindset

Customer outcomes

Tools

Postman

REST Assured

Karate

Playwright

Cypress

Selenium

Job description

About Leena AI

Leena AI is a leader in Agentic AI for the enterprise. We are building an iconic company, delivering AI Colleagues that transform back-office functions and accelerate the full promise of Generative AI - unlocking real productivity gains, cutting costs, and delighting employees at scale.

Leena AI provides the most forward-looking, open, and scalable Agentic AI architecture for the enterprise - it empowers CIOs and CTOs to develop, deploy, and manage AI Colleagues for the back office at scale. Built with full governance, compliance, security, and auditability at its core.

Leena AI integrates with 1000+ applications, including SAP, Salesforce, ServiceNow, Workday, and Microsoft Office 365. We are proud to be trusted by 500+ global enterprises and 20 million+ employees, including leading brands such as Nestlé, Puma, Coca-Cola, Sony, and Etihad Airways.

Founded in 2018 and headquartered in New York, Leena AI has secured over $40M in financing from top-tier investors including Greycroft, Bessemer Venture Partners, B Capital, and Y Combinator.

Role Overview

As a Senior QA Engineer, you will be responsible for testing and validating Leena AI's Pre-built AI Colleagues, including Universal HR Assistant, Universal IT Assistant, and Universal Finance Assistant.

This is not a conventional QA role limited to UI and API testing. You will test AI-powered enterprise automation where the product must understand employee intent, retrieve the right knowledge, execute workflows, integrate with enterprise systems, respect access controls, and deliver reliable outcomes across multiple customer environments.

You will work closely with Product, Engineering, Solutions, Customer Success, and Implementation teams to ensure that our AI Colleagues are accurate, safe, reliable, enterprise-ready, and launch-ready.

What You'll Own

• Own end-to-end QA for pre-built AI Colleague use cases across HR, IT, Finance, and other enterprise functions.
• Validate employee journeys, business workflows, and multi-step processes across standard and customer-specific configurations.
• Test enterprise integrations, APIs, authentication, data mapping, error handling, permissions, and workflow execution.
• Evaluate AI/LLM behavior, including intent understanding, knowledge retrieval, response accuracy, tool invocation, hallucinations, and task completion.
• Design test scenarios covering happy paths, edge cases, ambiguous queries, and failure scenarios.
• Build and maintain automated regression suites across UI, APIs, integrations, and backend workflows.
• Drive release readiness through CI/CD quality gates, production issue analysis, and regression testing.
• Validate enterprise readiness across security, tenant isolation, access controls, privacy, reliability, and performance.
• Partner with Engineering and Implementation teams to debug issues, improve testability, and support customer UAT.

What We're Looking For

Must have

• 4-8 years of QA experience in enterprise SaaS, B2B software, workflow automation, ITSM, HRTech, FinTech, ERP, or CRM products.
• Strong experience testing complex enterprise workflows and third-party integrations.
• Hands-on API testing experience with Postman, REST Assured, Karate, or similar tools.
• Test automation experience with Playwright, Cypress, Selenium, or equivalent frameworks.
• Understanding of backend systems, APIs, databases, logs, webhooks, and asynchronous processing.
• Ability to debug issues using logs, API responses, database queries, and monitoring tools.
• Strong test design skills across functional, negative, edge-case, and role-based scenarios.
• Product mindset focused on customer outcomes, business logic, and end-to-end quality.

Good to Have

• Experience with HR, IT, Finance, or employee service automation products and enterprise platforms such as Workday, ServiceNow, SAP, Salesforce, or Microsoft 365.
• Experience testing AI/LLM products, copilots, RAG systems, or agentic workflows.
• Familiarity with LLM evaluation, hallucination testing, prompt variations, knowledge retrieval, and response quality assessment.
• Exposure to multi-tenant SaaS, RBAC, SSO, OAuth, SAML, audit logs, and compliance.
• Experience with performance testing, test data management, and basic SQL/NoSQL.

Skills: api testing,autommation testing,b2b saas