AI Agentic Studio QA

Coditude; Pune District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Coditude is seeking an AI Agentic Studio QA professional with about 4 years of experience in quality assurance and test automation. The role focuses on developing robust test strategies, maintaining automated coverage for web apps and APIs, and validating AI-enabled workflows involving LLMs, multi-agent systems, RAG, tool calling, MCP, embeddings, and vector databases.

Key responsibilities include designing test strategies, performing manual and automated testing, building and refining test

Qualifications

• Proficiency in Java programming and Git version control.
• Hands-on web test automation using Selenium WebDriver with Java.
• Experience in API testing and automation (Postman, REST Assured).
• Familiar with TestNG framework, Maven, and CI/CD tools (Jenkins).
• Knowledge of Docker and containerization concepts.
• Understanding of LLM testing concepts (multi-agent systems, RAG, tool calling) and embeddings.

Responsibilities

• Design test strategies and detailed test cases for complex features and workflows.
• Perform manual and automated testing to identify, document, track, and verify bugs and defects.
• Create, maintain, and improve automated test suites for functional, integration, web, and API testing.
• Participate in code reviews and provide feedback on test automation code.
• Collaborate with developers and product managers to troubleshoot issues and clarify requirements.
• Participate in Agile/Scrum ceremonies and communicate testing progress.

Skills

Java

Git

Selenium

API Testing

TestNG

Maven

Jenkins

Docker

LLM Testing

Embeddings

Vector Databases

Prompt Engineering

Agile/Scrum

Jira

Wiki

Tools

Postman

REST Assured

IntelliJ IDEA

Job description

Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance

and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for

web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs),

multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases.

Key Responsibilities

• Design test strategies and detailed test cases for complex features and workflows.


• Perform manual and automated testing to identify, document, track, and verify bugs and defects.


• Create, maintain, and improve automated test suites for functional, integration, web, and API testing.


• Participate in code reviews and provide constructive feedback on test automation code.


• Collaborate with developers and product managers to investigate issues, debug failures, and clarify requirements.


• Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open issues.


• Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality.

Required Skills & Qualifications

• Proficiency in Java programming and Git version control.


• Hands-on experience with web test automation using Selenium WebDriver and Java.


• Experience in API testing and automation, with working knowledge of Postman and REST Assured.


• Experience with the TestNG testing framework.


• Working knowledge of Maven and IntelliJ IDEA.


• Experience with or knowledge of Jenkins and CI/CD workflows.


• Understanding of Docker and containerization concepts.


• Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP.


• Knowledge of testing embeddings and vector databases.


• Experience with prompt engineering and prompt/output validation.


• Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.