GEN AI testing Engineer

Virtusa; Bengaluru; On-site; INR 600,000 - 1,000,000; Full time

Job summary

Virtusa is seeking an AI Testing Specialist to join our team in Bengaluru. The ideal candidate will test AI-based applications and systems, with a strong grasp of AI/ML concepts and testing methodologies.

You will develop and maintain automated test frameworks, and design benchmarks to evaluate model performance. Requirements include 1-3 years in AI testing, proficiency in Python and AI frameworks, and knowledge of SDLC/STLC with AI-focused testing phases.

Qualifications

• Bachelor’s degree in CS/DS/ML or related field.
• 1-3 years of AI testing or QA experience.
• Experience with testing AI-based applications and systems.

Responsibilities

• Collaborate with AI test team to plan and execute test plans, cases and scenarios for AI systems.
• Develop, execute, maintain, and enhance automated test frameworks and scripts for AI component testing.
• Implement QA standards to ensure accuracy, reliability and performance of AI solutions.
• Design benchmarking tests to evaluate AI system performance against industry standards and competitors.
• Expand knowledge in testing deep learning algorithms and model families.

Skills

Python

Image processing

Data processing

Automation testing

AI testing concepts

Education

Bachelor’s in Computer Science, Data Science, ML or related

Tools

TensorFlow

Keras

PyTorch

CI/CD pipelines for AI

Job description

Job Requirements

AI Testing Specialist

We are seeking a skilled AI Testing Specialist to join our team. The ideal candidate will have experience in testing AI-based applications and systems, with a strong understanding of AI/ML concepts and testing methodologies

Responsibilities

• Collaborate with the AI test team to plan and execute test plans, test cases, and test scenarios for AI systems.
• Develop, execute, maintain, and enhance automated test frameworks and scripts dedicated to AI component testing.
• Implement quality assurance standards to ensure the accuracy, reliability, and performance of AI solutions.
• Design and implement benchmarking tests to evaluate AI system performance against industry standards and competitors.
• Expand knowledge in testing deep learning algorithms and model families.

Required Skills

• Proficiency in Python and related packages for image processing, data processing, and automation testing.
• Familiarity with machine/deep learning frameworks like TensorFlow, Keras, or PyTorch.
• Understanding of Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC), with a focus on AI-specific testing phases and activities.
• Experience in testing AI-driven applications across diverse platforms.

Qualification

• Bachelor’s in Computer Science, Data Science, Machine Learning, or related fields.
• 1-3 years of experience in AI testing, deep learning, or quality assurance.
• Preferred Qualifications:
• Proficiency in machine learning pipelines and Continuous Integration/Continuous Deployment (CI/CD) pipelines tailored for AI development and testing -workflows.
• Knowledge of advanced image processing algorithms.
• Experience with cloud computing platforms such as AWS or Azure, particularly in the context of testing AI solutions in cloud environments.
• Strong statistical analysis skills to evaluate model performance, validate results, and identify potential issues during AI testing.

Work Experience

5-7Years