AI Test Engineer

Ascendion; India; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Ascendion is seeking an experienced QA Engineer focused on AI/ML products in India. You will drive testing for Generative AI solutions, validate agentic AI behaviours, and ensure compliance with Responsible AI standards.

The role requires collaboration across DevSecOps teams and robust test management using Jira/Azure DevOps. You will design test plans, run automation, perform UAT, report defects, and contribute QA metrics to improve quality of AI systems.

Qualifications

• Experience of test automations and tools (e.g., Tosca, Python, Selenium).
• Strong knowledge of QA methodologies (Agile, Waterfall, DevOps, BDD).
• Proven QA Engineer with AI/ML product testing focus.
• Agentic AI testing and validation experience.
• Knowledge of Responsible AI (fairness, privacy, security in AI).
• Familiarity with Agentic AI concepts and architectures.
• DevSecOps collaboration experience.
• Experience with GenAI testing (model outputs, prompts).
• Testing across functional, integration, performance, compatibility.
• Test management tools (Jira, Azure DevOps).
• Strong communication and multi-tasking.

Skills

QA methodologies

GenAI testing

Agentic AI testing

Responsible AI

DevSecOps

UAT

Test management

Jira/Azure DevOps

Performance testing

Load testing

Data governance

Data quality

C#

Java

Tools

C#

Java

Job description

• Experience of test automations and tools, e.g. Tosca, Python, Selenium
• Strong knowledge & use of QA methodologies e.g. Agile, Waterfall, DevOps, BDD for functional test activities.
• Proven experience as a Quality Assurance Engineer, with a significant focus on testing Artificial Intelligence and Machine Learning products.
• Agentic AI Agent testing and validation.
• Strong knowledge of Responsible AI principles and practices, including experience in testing for fairness, bias detection, explainability, privacy, and security in AI systems.
• Familiarity with Agentic AI concepts and architectures.
• Experience in working with teams in DevSecOps
• In-depth knowledge of test toolsets and development languages including C#, Java
• Solid understanding and practical experience in testing Generative AI (GenAI) Solutions, including evaluating model outputs, prompt engineering, and understanding the nuances of generative models.
• Understanding of DevOps pipeline i.e. change, release & deployment processes
• Experience in conducting UAT, defect reporting & triage and preparing QA metrics
• Understanding across multiple disciplines of test, e.g. functional, integration, performance, compatibility
• Test management tool expertise (such as Atlassian Jira, Azure DevOps etc.)
• Strong written, verbal and presentation skills
• Professional and confident with a strong drive & enthusiasm to multi-task.
• A proven track record in a top tier consultancy or a large enterprise / organisation
• .Direct experience in testing Agentic AI Solutions, including evaluating agent behaviour, goal achievement, and interaction patterns
• .Experience with performance testing and load testing of AI models and applications
• .Knowledge of data governance and data quality best practices in an AI context