Senior AI Model Validator | Risk Analytics & Governance

Charles Schwab; Orlando (FL); Hybrid; USD 90,000 - 135,000; Full time

Benefits offered by this job

401(k) match

Employee stock purchase plan

Vacation time

Sabbatical

Parental leave

Tuition reimbursement

Health insurance

Job summary

Charles Schwab in Orlando is seeking an early‑career engineer or quantitative researcher to join the AI/Model Risk Oversight team, focusing on validating AI/ML systems, with emphasis on generative AI and large language models. You will write code, design tests, evaluate model behavior, and present evidence to engineers and leaders while collaborating with risk partners and product teams.

This role offers hybrid work, standard hours, and opportunities to build reusable validation frameworks and

Qualifications

• Master’s degree or Bachelor’s with strong project/research experience in a relevant field.
• 0‑2 years of professional experience. Internships, research, or open-source work welcome.
• Proficiency in Python and common data science or ML libraries.
• Working knowledge of core ML concepts, experimental design, model evaluation, and statistical reasoning.
• Ability to read technical documentation and code, investigate unfamiliar systems, and communicate conclusions clearly.
• Curiosity, sound judgement, attention to detail, and willingness to challenge assumptions with evidence.

Responsibilities

• Validate AI/ML models by assessing use, design, data, implementation, controls, performance, and limitations.
• Build reproducible testing frameworks, analyses, and prototypes to evaluate quality, robustness, safety, and reliability.
• Evaluate generative AI and retrieval‑augmented generation applications (prompt behavior, retrieval quality, groundedness, hallucination risk, consistency, guardrails).
• Apply statistical and ML methods to benchmark models, analyze errors, compare alternatives, and assess results.
• Review source code, notebooks, technical documentation, model inventories, performance monitoring, and production evidence.
• Partner with model developers, product teams, data scientists, engineers, risk partners, and external consultants to understand systems and challenge assumptions.
• Document findings in validation reports, technical appendices, issue statements, and executive‑ready presentations.
• Evaluate ongoing performance monitoring and participate in periodic model reviews post‑implementation.
• Contribute to reusable validation frameworks and testing utilities as AI capabilities evolve.

Skills

Python

Experimental design

Statistical reasoning

Code comprehension

Communication

Education

Master’s degree

Bachelor’s with strong project/research

Tools

Git

SQL

Containers

Cloud platforms

ML development workflows

Job description

Charles Schwab in Orlando is seeking an early‑career engineer or quantitative researcher to join the AI/Model Risk Oversight team, focusing on validating AI/ML systems, with emphasis on generative AI and large language models. You will write code, design tests, evaluate model behavior, and present evidence to engineers and leaders while collaborating with risk partners and product teams.

This role offers hybrid work, standard hours, and opportunities to build reusable validation frameworks and