Analyst

Tata Consultancy Services; Charlotte (NC); On-site; USD 90,000 - 107,000; Full time

Job summary

Tata Consultancy Services in Charlotte, NC seeks an experienced AI testing professional to design end-to-end test plans for generative AI, LLMS, and ML models. The role emphasizes model validation, automation, and data quality to ensure robust, secure AI deployments.

Candidates should have at least 8 years of testing experience, strong Python/PyTest skills, and a background in automation tools. The position focuses on leadership and collaboration with data scientists and software engineers.

Qualifications

• Bachelor’s or master’s degree in computer science or related field.
• Minimum 8 years of experience in testing AI applications and ML systems.
• Experience designing end-to-end test plans for generative AI, LLMs, and ML models.

Responsibilities

• Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
• Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation

Skills

Test AI applications

RAG systems

agents

APIs

Data Pipeline

Python

PyTest

AI testing tools

Education

Bachelor’s or Master’s degree in computer science or related field

Tools

Python

PyTest

AI testing tools

Job description

Job Description

Must Have Technical/Functional Skills

Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework

Experience: Minimum 8 years

Roles & Responsibilities

Bachelor’s or master’s degree in computer science or related field.

Key Responsibilities

• Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
• Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $90,000 – 107,000 a year

Qualifications

BACHELOR OF COMPUTER SCIENCE