Senior AI Test & Validation Lead

Tata Consultancy Services Limited; Charlotte (NC); On-site; USD 90,000 - 107,000; Full time

Job summary

Tata Consultancy Services Limited in Charlotte, NC seeks an experienced Analyst to lead end-to-end testing for generative AI, LLMs, and machine learning models. The role involves validating models for accuracy, drift, latency, robustness and security, and building advanced test automation with Python, PyTest, and AI tools.

The candidate will validate data quality across training/validation/test sets, assess bias and data leakage, and ensure data integrity while evaluating performance under heavy

Qualifications

• Minimum 8 years of test engineering experience in AI/ML or related fields.
• Bachelor's or master’s degree in computer science or related field.
• Experience with automated testing frameworks and data pipelines.

Responsibilities

• Lead end-to-end test plans for generative AI, LLMs, and ML models.
• Validate models for accuracy, drift, latency, robustness and security vulnerabilities.
• Build advanced test automation frameworks using Python, PyTest, and AI testing tools.
• Validate training, validation, and test datasets for bias, leakage and data integrity.
• Evaluate system scalability and response times under heavy concurrent loads.
• Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation.

Skills

AI test applications

Manual testing

Education

Bachelor's or Master’s in Computer Science

Job description

Tata Consultancy Services Limited in Charlotte, NC seeks an experienced Analyst to lead end-to-end testing for generative AI, LLMs, and machine learning models. The role involves validating models for accuracy, drift, latency, robustness and security, and building advanced test automation with Python, PyTest, and AI tools.

The candidate will validate data quality across training/validation/test sets, assess bias and data leakage, and ensure data integrity while evaluating performance under heavy