Automation Testing (Playwright, Python, and AI testing with Selenium)

Tata Consultancy Services; India; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Tata Consultancy Services invites an experienced software tester with 5+ years of hands-on AI/ML testing to join our team in India. You will work with C#, .NET, Python, and PowerShell, and utilize Azure AI/ML services to build robust test strategies.

You will implement CI/CD pipelines, leverage Azure DevOps, and apply ML evaluation metrics such as accuracy, precision, recall, and F1 score in testing ML models and pipelines.

Qualifications

• Minimum 5+ years of software testing experience with at least 12 years focused on AI/ML testing.
• Hands-on experience with C#, .NET, Python and PowerShell scripting.
• Experience with Azure AI/ML services: Azure OpenAI, Azure Machine Learning, Azure Cognitive Services.
• Expertise in Azure DevOps, Test Plans, and CI/CD pipeline implementation.
• Proficiency with automation frameworks MSTest, NUnit, xUnit, and web testing with Playwright/Selenium.
• Strong understanding of ML concepts including model evaluation metrics (Accuracy, Precision, Recall, F1 score) and training vs inference pipelines.

Responsibilities

• Design and execute AI/ML testing strategies for Azure-based services.
• Develop and maintain automation test suites using MSTest/NUnit/xUnit and Playwright/Selenium.
• Collaborate with cross-functional teams to validate model performance and deployment pipelines.
• Implement and optimize CI/CD pipelines for ML model testing.

Skills

AI/ML testing

C#

.NET

Python

PowerShell scripting

Azure DevOps

CI/CD pipelines

ML concepts

Model evaluation metrics

Training vs inference pipelines

Azure OpenAI

Azure Machine Learning

Azure Cognitive Services

Playwright

Selenium

Education

Bachelor’s degree in a relevant field

Tools

MSTest

NUnit

xUnit

Job description

Role & responsibilities

• 5+ years of experience in software testing with minimum 12 years in AI/ML testing
• Strong hands-on experience with C#, .NET, Python and PowerShell scripting
• Experience working with Azure AI/ML services:
  • Azure OpenAI
  • Azure Machine Learning
  • Azure Cognitive Services
• Expertise in Azure DevOps, Test Plans, and CI/CD pipeline implementation
• Experience with automation frameworks:
  • MSTest, NUnit, xUnit
  • Playwright / Selenium
• Strong understanding of ML concepts:
  • Model evaluation metrics (Accuracy, Precision, Recall, F1 score)
  • Training vs inference pipelines

Preferred candidate profile