QA Engineer – GenAI & Automation

NStarX Inc.; Hyderabad; On-site; INR 2,800,000 - 4,000,000; Full time

Job summary

NStarX Inc. in Hyderabad seeks a QA Engineer – GenAI & Automation to test the full AI platform stack, including deployments, authentication, generation workflows, APIs, and UI. You'll handle non-deterministic outputs and quality gates.

You will own test strategies, expand the automation framework, and validate generated outputs such as PPTX/DOCX/PDFs while ensuring secure access via SSO/SAML and RBAC.

Qualifications

• 5+ years of Software QA / Test Automation experience.
• Strong automation skills with Python/pytest or JavaScript (Playwright/Cypress).
• Hands-on API and integration testing experience.
• Experience with authentication, authorization, RBAC, and negative scenarios.

Responsibilities

• Own test strategy, test cases, and automation across the stack.
• Maintain and enhance automated tests and CI/CD integration.
• Test AI generation workflows and verify quality gates.
• Validate outputs and ensure unsafe content is withheld.
• Perform API, integration, UI, and end-to-end testing.
• Validate document outputs (PPTX, DOCX, PDFs).
• Test SSO/SAML login and multi-user session behaviour.
• Identify, reproduce, and document defects clearly.

Skills

QA Automation

Python/pytest

Playwright/Cypress

API Testing

Integration Testing

End-to-end testing

RBAC

SAML

CI/CD

Documentation

Tools

python-pptx

python-docx

PDF parsing

Job description

QA Engineer – GenAI & Automation

NStarX is an AI-first, Cloud-first engineering services company focused on AI, ML, Cloud, Automation, and Software Engineering. We help organizations accelerate business value through modern technology and engineering solutions.

ABOUT THE ROLE

We are looking for a QA Engineer – GenAI & Automation to test the complete technology stack of a Generative AI platform, including deployment, authentication, generation workflows, APIs, document exports, and UI. The role involves testing non-deterministic AI outputs, quality gates, and fail-closed behaviour.

KEY RESPONSIBILITIES

• Own the test strategy, test cases, and automation across the application stack.
• Maintain and enhance the existing automated test suite.
• Test AI generation workflows and verify fail-closed quality gates.
• Validate AI-generated outputs and ensure ungrounded or invalid content is appropriately withheld.
• Perform API, integration, UI, and end-to-end testing.
• Validate generated PPTX, DOCX, and PDF files against defined output contracts.
• Test SSO/SAML login, RBAC, authorization, and multi-user session behaviour.
• Validate UI error, loading, waiting, refusal, and edge-case states.
• Provide test evidence for quality gates, demos, and release reviews.

REQUIRED SKILLS & EXPERIENCE

• 5+ years of experience in Software QA / Test Automation.
• Strong experience with Python/pytest and/or JavaScript with Playwright/Cypress.
• Hands-on experience with API and integration testing.
• Experience testing authentication, authorization, RBAC, and negative scenarios.
• Strong understanding of end-to-end testing across distributed applications.
• Ability to take ownership of and extend an inherited automation framework.
• Strong defect analysis, troubleshooting, and documentation skills.

GOOD TO HAVE

• Experience testing Generative AI / LLM applications and non-deterministic outputs.
• Knowledge of golden-file and contract-based testing.
• Experience validating generated documents using python-pptx, python-docx, PDF parsing, or similar tools.
• Experience integrating automated tests into CI/CD pipelines.
• Knowledge of performance and load testing.

KEY COMPETENCIES

QA Automation | Python | Pytest | Playwright | Cypress | API Testing | Integration Testing | GenAI Testing | LLM Testing | UI Testing | SSO/SAML | RBAC | Document Validation | CI/CD | Performance Testing