AI Model Validation Specialist — Gen AI & LLMs

Charles Schwab Corporation; Southlake (TX); Hybrid; USD 110,000 - 140,000; Full time

Job summary

Charles Schwab Corporation is seeking an early-career engineer or quantitative researcher to join the AI Model Validation team. This role focuses on hands-on evaluation of AI/ML systems, with emphasis on generative AI and large language models, across development and production phases.

The position offers a hybrid work model (4 days in-office, 1 day remote) and requires strong fundamentals in Python, statistics, and experimental design, plus clear technical communication to diverse stakeholders.

Qualifications

• Master's degree or Bachelor's with strong research or project experience.
• 0-2 years of professional experience; internships welcome.
• Proficiency in Python and common ML/data science libraries.
• Able to read technical documentation and code, investigate unfamiliar systems, and communicate conclusions clearly.
• Curiosity, sound judgment, attention to detail, and willingness to challenge assumptions with evidence.

Responsibilities

• Validate AI/ML models across intended use, design choices, data, implementation, controls, performance, and limitations.
• Build reproducible testing frameworks, analyses, and prototypes to evaluate model quality, robustness, safety, and reliability.
• Evaluate generative AI and retrieval-augmented generation applications, including prompt behavior, retrieval quality, groundedness, hallucination risk, response consistency, and guardrail effectiveness.
• Apply statistical and machine learning methods to benchmark models, analyze errors, compare alternatives, and assess results.
• Review source code, notebooks, technical documentation, model inventories, performance monitoring, and production-control evidence.
• Partner with model developers, product teams, data scientists, engineers, risk partners, and external consultants to understand systems and challenge assumptions constructively.
• Document findings in clear validation reports, technical appendices, issue statements, and executive-ready presentations.
• Evaluate ongoing performance monitoring and participate in periodic reviews of models after implementation.
• Contribute to reusable validation frameworks, testing utilities, and effective-challenge methods as AI capabilities and industry practices evolve.

Skills

Python

Experiment design

Statistical reasoning

Communication

Curiosity

Education

Master's degree or Bachelor's + project experience

Tools

Git

SQL

Containers

Cloud platforms

ML libraries

Job description

Charles Schwab Corporation is seeking an early-career engineer or quantitative researcher to join the AI Model Validation team. This role focuses on hands-on evaluation of AI/ML systems, with emphasis on generative AI and large language models, across development and production phases.

The position offers a hybrid work model (4 days in-office, 1 day remote) and requires strong fundamentals in Python, statistics, and experimental design, plus clear technical communication to diverse stakeholders.