Senior AI Testing Architect | LLM & RAG Validation Lead

Tata Consultancy Services; Charlotte (NC); Presencial; USD 90.000 - 107.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services in Charlotte, NC seeks an experienced AI testing professional to design end-to-end test plans for generative AI, LLMS, and ML models. The role emphasizes model validation, automation, and data quality to ensure robust, secure AI deployments.

Candidates should have at least 8 years of testing experience, strong Python/PyTest skills, and a background in automation tools. The position focuses on leadership and collaboration with data scientists and software engineers.

Formación

• Bachelor’s or master’s degree in computer science or related field.
• Minimum 8 years of experience in testing AI applications and ML systems.
• Experience designing end-to-end test plans for generative AI, LLMs, and ML models.

Responsabilidades

• Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
• Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation

Conocimientos

Test AI applications

RAG systems

agents

APIs

Data Pipeline

Python

PyTest

AI testing tools

Educación

Bachelor’s or Master’s degree in computer science or related field

Herramientas

Python

PyTest

AI testing tools

Descripción del empleo

Tata Consultancy Services in Charlotte, NC seeks an experienced AI testing professional to design end-to-end test plans for generative AI, LLMS, and ML models. The role emphasizes model validation, automation, and data quality to ensure robust, secure AI deployments.

Candidates should have at least 8 years of testing experience, strong Python/PyTest skills, and a background in automation tools. The position focuses on leadership and collaboration with data scientists and software engineers.