AI QA Engineer Mid · Full-time · Remote / Hybrid →

Thewebvale; Bhopal; Hybrid; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Remote-first with Bhopal studio

Real client products across industries

Direct work with the founder

Learning and tooling support

Work featured in public portfolio

Job summary

TheWebVale is seeking an AI QA Engineer to test AI-powered client platforms, validate boundary conditions, and catch edge-case errors across applications.

You will develop test plans, execute adversarial testing, and verify JSON schemas and database integrity while collaborating with engineers and the founder during our release cadences. This remote-first role offers hybrid days at the Bhopal studio and exposure to diverse client products across industries.

Qualifications

• 2–4 years of software testing experience with exposure to AI and language models.
• Proficient in Python or modern JavaScript for test scripts.
• Understanding of how language models generate text, handle context, and fail.
• Experience testing web applications, API endpoints, and database records.
• Strong adversarial thinking to anticipate how users might break AI features.
• Clear communication of software defects and edge-case behaviors.

Responsibilities

• Develop detailed test plans for AI-driven features, chatbots, and document summarizers.
• Execute exploratory and adversarial testing to uncover hallucinations and model misbehavior.
• Verify that model outputs conform strictly to required JSON schemas and database types.
• Test application resilience against prompt injection attempts, toxic inputs, and spam.
• Document reproducible bug reports with input prompts, seed parameters, and system configs.
• Work alongside developers to re-test prompt adjustments and verify regression fixes.

Skills

QA testing

Python scripting

Adversarial thinking

API testing

Tools

Postman

JSON Schema

Job description

You will test artificial intelligence features, validate boundary conditions, and catch edge-case errors across client applications.

As an AI QA Engineer at TheWebVale, you will perform systematic quality assurance on AI-powered client platforms. You will test chatbot flows, RAG search pipelines, and automated text extractors for clinics, educational platforms, and commercial businesses. You will partner with software engineers and our founder during our two-to-three week release cadences. You will stress-test AI outputs against unexpected inputs, test language variations, and ensure client software behaves reliably.

Responsibilities

Your day to day.

6 things, one at a time. Keep scrolling.

• Develop detailed test plans for AI-driven features, chatbots, and document summarizers.
• Execute exploratory and adversarial testing to uncover hallucinations and model misbehavior.
• Verify that model outputs conform strictly to required JSON schemas and database types.
• Test application resilience against prompt injection attempts, toxic inputs, and spam.
• Document reproducible bug reports with input prompts, seed parameters, and system configs.
• Work alongside developers to re-test prompt adjustments and verify regression fixes.

Requirements

What we look for.

6 things, one at a time. Keep scrolling.

• Possess 2–4 years of software testing experience with exposure to AI and language models.
• Demonstrate practical skill writing test scripts in Python or modern JavaScript.
• Show understanding of how language models generate text, handle context, and fail.
• Possess experience testing web applications, API endpoints, and database records.
• Exhibit strong adversarial thinking to anticipate how users might break AI features.
• Communicate software defects and edge-case behaviors clearly to the team.

What you get.

thewebvale.

• Remote-first, with a Bhopal studio for hybrid days
• Real client products across many industries
• Direct work with the founder and senior team
• Learning and tooling support
• Your work featured in our public portfolio

How we hire

Three steps, no tricks.

• Intro chat

  A short call about what you want to work on and how you like to work.

• Work review

  Walk us through projects, code or designs you are proud of.

• Paid task

  A small paid task or pairing session, so both sides see the fit.