AI Quality Engineer (AWS)

Tata Consultancy Services; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Bengaluru seeks an AI Quality Engineer to ensure the quality of AI-driven applications on AWS. You will validate AI/ML models, develop test strategies, and lead automation efforts.

The role entails collaborating with data scientists and developers, testing data pipelines, and ensuring security and best practices across cloud-native AI solutions.

Qualifications

• Bachelor's or Master's degree in CS/IT/Engineering or related field.
• Experience in AI/ML testing and quality engineering.

Responsibilities

• Design, develop, and execute test strategies for AI/ML-based applications.
• Validate machine learning models for accuracy, reliability, bias, and performance.
• Develop automated testing frameworks for AI solutions and cloud-native applications.
• Perform functional, integration, regression, and performance testing.
• Validate data pipelines, model training outputs, and prediction results.
• Collaborate with Data Scientists, Machine Learning Engineers, Developers, and Product Teams.
• Create test plans, test cases, and detailed quality reports.
• Ensure compliance with quality standards, security requirements, and best practices.
• Identify defects, perform root cause analysis, and work with development teams for resolution.
• Drive continuous improvement in test automation and AI quality processes.

Skills

Quality Engineering

AWS Cloud Services

AI/ML Validation

Python

API Testing

CI/CD & DevOps

Test Automation

Cloud-native testing

Data quality testing

Education

Bachelor's/Master's in CS/IT/Engineering

Tools

Selenium

PyTest

JUnit

SageMaker

Job description

We are looking for a highly skilled AI Quality Engineer with strong expertise in AWS Cloud technologies, AI/ML validation, test automation, and quality engineering practices. The ideal candidate will be responsible for ensuring the quality, reliability, accuracy, and performance of AI-driven applications and machine learning solutions deployed on AWS platforms.

Key Responsibilities

• Design, develop, and execute test strategies for AI/ML-based applications.
• Validate machine learning models for accuracy, reliability, bias, and performance.
• Develop automated testing frameworks for AI solutions and cloud-native applications.
• Perform functional, integration, regression, and performance testing.
• Validate data pipelines, model training outputs, and prediction results.
• Collaborate with Data Scientists, Machine Learning Engineers, Developers, and Product Teams.
• Create test plans, test cases, and detailed quality reports.
• Ensure compliance with quality standards, security requirements, and best practices.
• Identify defects, perform root cause analysis, and work with development teams for resolution.
• Drive continuous improvement in test automation and AI quality processes.

Required Skills

• Strong experience in Quality Engineering / Software Testing
• Hands-on experience with AWS Cloud Services
• Experience testing AI/ML Models and Applications
• Knowledge of Machine Learning lifecycle and validation techniques
• Strong proficiency in Python
• Experience with API Testing and Test Automation
• Knowledge of CI/CD pipelines and DevOps practices
• Experience with cloud-native application testing
• Understanding of data quality validation and model performance testing

Preferred Skills

• Experience with Generative AI and Large Language Models (LLMs)
• Knowledge of MLOps practices
• Experience with Selenium, PyTest, JUnit, or similar automation frameworks
• Familiarity with AWS SageMaker, Lambda, S3, ECS/EKS
• Exposure to Agile/Scrum methodologies

Educational Qualification

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.