QA Analyst with AI

Tekskills; Bengaluru; Hybrid; INR 1,100,000 - 1,500,000; Full time

Job summary

Tekskills is hiring a QA Associate Engineer (AI Testing) with 4–7 years of experience. The role centers on AI QA, LLM behavior analysis, prompt engineering and data-pipeline testing. On-site/hybrid work in Pune, Hyderabad, or Bangalore aligns with project needs.

You will design adversarial tests, perform RAG evaluation, and integrate LLM test suites into CI/CD (Azure DevOps, GitHub Actions). Expect synthetic data management and clear defect documentation for triage.

Qualifications

• At least 4 years of software quality assurance with a focus on AI solutions.
• Hands-on experience with LLM behaviour, hallucinations, bias and edge-case handling.
• Experience in designing adversarial and robustness test cases for AI systems.
• Familiarity with AI QA in data pipelines and synthetic data management.
• Ability to integrate LLM test suites into CI/CD pipelines and triage defects.

Responsibilities

• Design and execute test plans for AI-based QA solutions.
• Create adversarial tests to validate robustness of AI models.
• Validate data pipelines and ensure input/output integrity for training and retrieval systems.
• Integrate LLM-focused test suites into CI/CD workflows (Azure DevOps, GitHub Actions).
• Document defects clearly and support triage with engineering teams.

Skills

LLM behaviour

Prompt engineering

AI data pipelines

CI/CD integration

LLM test generation

RAG evaluation

Guardrails testing

Synthetic data

Data coverage auditing

Defect documentation

Tools

Azure DevOps

GitHub Actions

Job description

We are currently hiring for a QA Testing Engineer AI Focused role, and your profile seems to match our requirements.

Please find the job details below:

Position: QA Associate Engineer (AI Testing)

Experience: 4 to 7 Years

Location: Pune / Hyderabad / Bangalore (On-site/Hybrid – as per project)

Job Description – QA Associate Engineer

Minimum Experience:

• At least 4 years of experience in software quality assurance, with a focus on AI solutions.

Must Have Hands-On Experience In:

• Deep understanding of LLM behaviour, including hallucinations, bias, and edge-case handling.
• Prompt engineering to design adversarial and robustness test cases.
• Conducting photo validation and recognition tests to ensure accuracy in AI-driven quality audits.
• Integrating LLM-focused test suites into CI/CD pipelines (Azure DevOps, GitHub Actions).
• LLM test case generation, RAG evaluation, and use of guardrails for secure, explainable testing.
• Strong background in data pipeline testing, ensuring input/output integrity of training and retrieval systems.
• Managing test data, generating synthetic data, and auditing data coverage.
• Documenting defects clearly and supporting triage with engineering teams.