QA Engineer – AI Solutions

DoubleTick; Mumbai; On-site; INR 600,000 - 900,000; Full time

Job summary

DoubleTick.io, headquartered in Mumbai, is seeking a QA Engineer - AI Solutions to own and scale our paid acquisition and demand-generation engine. You will build AI test suites for voice and chat deployments, validate prompts and end-to-end flows, and ensure quality before live enterprise releases.

The role blends performance marketing insight with B2B SaaS testing, requiring strong docs, API testing experience, and comfort in fast-moving, multi-stakeholder environments.

Qualifications

• 1-5 years of QA experience with API or conversational/AI product testing.
• Ability to think in user journeys and edge cases beyond checklists.
• Proficiency with API testing tools (Postman or equivalent).
• Strong documentation to convey test cases and findings clearly.
• Comfort in fast-moving, ambiguous delivery environments with multiple stakeholders.

Responsibilities

• Own and scale AI test suites for AI voice and chat deployments across channels.
• Validate prompt behaviour, intent classification, fallback handling and responses.
• Test end-to-end flows from user input through LLM processing to API callbacks.
• Document edge cases in conversational logic for cross-functional teams.
• Define and maintain a standardised playbook of test cases for deployments.

Skills

QA experience

API testing

Documentation

Edge-case thinking

Stakeholder communication

Tools

Postman

Jira

Notion

Job description

DoubleTick.io , an award-winning conversational CX stack, is looking for a QA Engineer - AI Solutions to own and scale our paid acquisition and demand-generation engine.

This role is ideal for someone who combines strong performance marketing expertise with a sharp understanding of B2B SaaS funnels and can translate marketing investments into qualified leads, pipeline, and revenue.

What You'll Do

AI Deployment Validation

• Build and maintain AI test suites for AI voice and chat deployments across WhatsApp, PSTN, and SIP channels.
• Validate prompt behaviour, intent classification accuracy, fallback handling, and response quality across defined user journeys.
• Test end-to-end integration flows - from user input through LLM processing to API callbacks and CRM/backend updates.
• Identify and document edge cases in conversational logic that neither the product team nor client strategy teams typically surface.

Test Infrastructure & Documentation

• Define and maintain a standardised playbook of test cases for recurring deployment patterns (sales bots, support agents, lead qualification flows, etc.).
• Author VRDs (Validation & Requirement Documents) in collaboration with Solution Engineers - documents that translate client requirements intIsDSo testable acceptance criteria.
• Ensure VRDs are implementation-ready and serve as the source of truth for Go-live sign-off across delivery projects.
• Maintain test logs, failure reports, and regression records per deployment.

Cross Functional Delivery Ownership

• Be present across the full delivery lifecycle - from solutioning review to UAT to post-deployment monitoring.
• Raise quality flags proactively during project scoping, not just at the testing stage.
• Act as the quality gate before any AI solution goes live with an enterprise client.

What we are looking for

Must Have

• 1-5 years of experience in QA, with at least some exposure to API testing or conversational/AI product testing.
• Ability to think in user journeys and edge cases - not just pass/fail checklists.
• Proficiency with API testing tools (Postman or equivalent) to validate webhook flows and integration endpoints.
• Strong documentation instinct - you write test cases and findings that others can act on without asking you follow-up questions.
• Comfort working in fast-moving, ambiguous delivery environments with multiple stakeholders.

Good to Have

• Prior experience testing LLM-based products, chatbots, or voice bots.
• Familiarity with WhatsApp Business API or any conversational platform.
• Basic scripting ability (Python or JS) to automate repetitive test scenarios.
• Exposure to tools like Jira, Notion, or any structured project delivery environment.

What Success Looks Like

• Zero post-Go-live critical failures attributable to untested conversational logic.
• A growing, reusable test case library that reduces QA cycle time per deployment.
• VRDs that are consistently implementation-ready with no back-and-forth on scope.
• You're the person the delivery team pulls in early - not at the end.

DoubleTick.io headquartered in Mumbai, is a Meta award-winning AI conversational CX stack, designed to unlock conversation-led sales, marketing, and customer engagement use-cases at scale for enterprises . Backed by Info Edge Ventures and BeeNext, the platform serves 10,000+ businesses across India and UAE and serves large clients across various industries like BFSI, Real Estate, Travel, EdTech, Healthcare, Auto, Retail and FMCG. Leading brands such as MakeMyTrip, Piramal Finance, CoinDCX, AU Bank, Lodha Developers among many others trust DoubleTick to power their customer conversations .

The UX friendly enterprise communication suite features a full-stack conversational platform featuring conversational centralization, automation and analytics across channels like WhatsApp chat, WhatsApp Voice, WhatsApp Groups, PSTN Calls among 10+ other channels. With its AI Agent Builder and Bot Studio enterprises can create and deploy complex AI Agents and Bots across chat and voice in minutes.

Why work with us?

• Fast-tracked career success into senior leadership positions
• Opportunity to own high value work and create impact at scale
• Opportunity to work closely with the founders and learn what it takes to grow a company in each stage of growth.
• Opportunity to work in a cultural environment where you can challenge founders/leadership and reason with them on any issue.
• Direct exposure to working with some of the largest enterprises in the world.