Analyst

Tata Consultancy Services; Charlotte (NC); On-site; USD 90,000 - 107,000; Full time

Job summary

Tata Consultancy Services Limited in Charlotte, NC seeks an experienced Analyst to lead end-to-end testing for generative AI, LLMs, and machine learning models. The role involves validating models for accuracy, drift, latency, robustness and security, and building advanced test automation with Python, PyTest, and AI tools.

The candidate will validate data quality across training/validation/test sets, assess bias and data leakage, and ensure data integrity while evaluating performance under heavy

Qualifications

• Minimum 8 years of test engineering experience in AI/ML or related fields.
• Bachelor's or master’s degree in computer science or related field.
• Experience with automated testing frameworks and data pipelines.

Responsibilities

• Lead end-to-end test plans for generative AI, LLMs, and ML models.
• Validate models for accuracy, drift, latency, robustness and security vulnerabilities.
• Build advanced test automation frameworks using Python, PyTest, and AI testing tools.
• Validate training, validation, and test datasets for bias, leakage and data integrity.
• Evaluate system scalability and response times under heavy concurrent loads.
• Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation.

Skills

AI test applications

Manual testing

Education

Bachelor's or Master’s in Computer Science

Job description

Must Have Technical/Functional Skills

Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework

Experience: Minimum 8 years

Roles & Responsibilities

Bachelor's or master's degree in computer science or related field.

Key Responsibilities

• Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
• Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $90,000 - 107,000 a year

Location

Charlotte, NC

Function

TECHNOLOGY

Role

Analyst

ID

430940

Skills

Manual Testing

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE