AI Test Engineer

Aziro; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Aziro in Bengaluru, India is seeking a QA engineer to design and validate AI-enabled applications, perform data validation, and ensure correctness of LLM outputs across multiple AI integrations and APIs.

You will develop both manual and automated tests, test prompts and model behavior under nondeterminism, implement CI/CD quality gates, and collaborate with developers to secure reliable delivery of AI-powered solutions within agile teams.

Qualifications

• Experience in manual and automated application testing.
• Proficient in Python programming.
• Familiar with CI/CD quality gates.

Responsibilities

• Design and validate AI-enabled applications.
• Data validation for AI-enabled applications.
• Validate LLM outputs.
• Test prompts, AI behaviour, and prompt versions.
• Automate functional and nonfunctional tests.
• Test AI integrations, APIs, and workflows.
• Perform regression testing for AI model/version changes.
• Collaborate with developers on quality gates.

Skills

App testing

Python

CI/CD gates

Job description

Role & responsibilities

• Design and validate AI enabled applications
• Data Validation for AI enabled applications
• Validate LLM outputs
• Test prompt versions and AI behaviour changes
• Automate functional and nonfunctional tests
• Test AI integrations, APIs, and workflows
• Perform regression testing for AI model/version changes
• Collaborate with developers on quality gates

Required Skills

• Application testing (manual + automation)
• Knowledge in Python
• CI/CD quality gates

AISpecific Skills

• Testing LLM outputs and prompt behavior
• Understanding of model variability and nondeterminism
• Test data management for AI
• Knowledge of responsible AI testing concepts