QA Tester – AI & LLM Platforms

Shenll Technology Solutions; Chennai District; On-site; INR 350,000 - 550,000; Full time

Job summary

Shenll Technology Solutions is seeking a QA Tester / QA Engineer with experience in AI, Generative AI, and LLM-based applications. You will perform manual testing, AI model testing, API testing, performance testing, and automation.

Responsibilities include testing AI chat and LLM-based applications across multiple AI models, validating conversation context, and multi-turn interactions. You will collaborate with developers in an Agile environment to ensure high-quality releases.

Qualifications

• Experience with manual testing, AI model testing, API testing, performance testing, and automation.
• Strong analytical and problem-solving capabilities.

Responsibilities

• Perform functional, regression, smoke, sanity, integration, and exploratory testing.
• Test AI chat and LLM-based applications across multiple AI models.
• Validate conversation context and multi-turn interactions.
• Test regeneration, retry, error handling, and model failure scenarios.
• Identify, document, and track defects using JIRA in an Agile environment.
• Collaborate with developers, product managers, and QA engineers in an Agile setting.

Skills

AI Chatbot Testing

Analytical Thinking

Job description

We are looking for a QA Tester / QA Engineer with experience in AI, Generative AI, and LLM-based applications. The candidate should have strong knowledge of manual testing, AI model testing, API testing, performance testing, and automation.

Responsibilities

• Perform functional, regression, smoke, sanity, integration, and exploratory testing.
• Test AI chat and LLM-based applications across multiple AI models.
• Test model switching and verify correct model responses.
• Validate conversation context and multi-turn interactions.
• Test regeneration, retry, error handling, and model failure scenarios.
• Validate AI response quality, accuracy, consistency, and relevance.
• Test AI credits, usage limits, and consumption calculations.
• Validate model-specific limits and rate limits.
• Test AI response time and performance.
• Verify handling of model timeouts, API failures, unavailable models, and unexpected responses.
• Test different prompt types and edge cases.
• Perform basic database validation using SQL.
• Perform performance and load testing using JMeter or Locust.
• Create and execute detailed AI/LLM test cases and test scenarios.
• Identify, document, and track defects using JIRA.
• Collaborate with developers, product managers, and QA engineers in an Agile environment.

Required Skills

• AI Chatbot Testing
• Good analytical and problem-solving skills

Preferred Experience

• 2–5 years of QA experience.
• Experience testing AI/LLM, Generative AI, chatbot, or AI-powered platforms.
• Understanding of AI model behavior, prompts, context handling, model switching, and response validation.
• Experience testing text, image, and video generation workflows.
• Experience with web and mobile application testing.