Risk Modeler III, Model Risk & AI, GenAI Model Validation

Credit One Bank

Las Vegas (NV)

On-site

USD 120,000 - 190,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Credit One Bank in Las Vegas is seeking a Risk Modeler III to independently validate quantitative, ML, GenAI, and agentic AI models. You will assess methodologies, data suitability, robustness, explainability, and monitoring, leading complex validations with minimal supervision.

You will work closely with Model Development and business stakeholders, preparing analyses and reports to support risk decisions and regulatory examinations, while advancing the GenAI validation framework.

Qualifications

  • Bachelor’s degree in AI, ML, Computational Science, Engineering, Statistics, Mathematics, Economics, or related field.
  • Strong knowledge of ML/AI methods and ability to evaluate generative AI and agentic AI systems.
  • Proficiency in Python and SQL for independent testing and validation.

Responsibilities

  • Lead end-to-end validation of generative AI, agentic AI, ML, and LLM-based models to ensure proper use.
  • Assess data suitability, conceptual soundness, implementation, robustness, reliability, explainability, and monitoring.
  • Design AI-specific testing including benchmarking, drift analysis, and explainability assessments.
  • Communicate validation conclusions, limitations, and findings to management and stakeholders.

Skills

Python
SQL
Model validation
Communication

Education

Bachelor’s degree in quantitative field
Master’s or PhD preferred

Tools

LLM testing tools

Job description

Description

Position Summary

The Risk Modeler III, Model Risk & AI, GenAI Model Validation is responsible for high-quality independent validation of quantitative, machine-learning, generative AI, and agentic AI models and tools. The role assesses whether methodologies, implementation, performance, controls, and monitoring are appropriate for their intended use and comply with Model Risk Management policies, standards, procedures, and applicable regulatory guidance. This role requires advanced technical expertise and minimal supervision to lead complex validations and remain accountable for validation conclusions across a wide range of model categories.

Summary Essential Job Functions
  • Lead end-to-end validation of generative AI, agentic AI, machine learning, and LLM-based models and tools to determine whether they perform effectively and are appropriate for their intended use.
  • Assess data suitability, conceptual soundness, implementation, robustness, reliability, explainability, human oversight, autonomy, controls, limitations, monitoring, and production readiness.
  • Design and execute AI-specific testing, including benchmarking, sensitivity and stress testing, stability and drift analysis, hallucination and output-reliability testing, explainability assessments, and evaluation of model limitations.
  • Independently identify material AI risks, provide credible challenge to Model Development and business stakeholders, and clearly communicate validation conclusions, limitations, and findings to management.
  • Lead the review and maintenance of relevant model validation documentation, perform in depth analysis on large data sets, and prepare analysis and reports to support discussions on key analytics, model performance and risks.
  • Enhance the existing GenAI model validation framework by developing standardized performance and reliability metrics.
  • Stay informed of developments in AI/ML, generative AI, agentic systems, validation methods, regulatory expectations, academia, risk technology, and the financial services industry.
  • Work closely within the Risk and other relevant functions to validate accuracy and performance of models and to identify issues requiring further investigation.
  • Support regulatory examinations and internal audits of the modeling process and selected model’s samples.
  • Continuously drive better model risk management practices and add value to the business through more efficiency, stronger controls, better process, and strong partnership with model stakeholders.
  • Perform other duties and/or special projects as assigned.
Position Requirements
  • Bachelor's degree in Artificial Intelligence, Machine Learning, Computational Science, Engineering, Statistics, Mathematics, Economics, or related Quantitative field.
  • Strong technical knowledge of machine-learning and AI methodologies, with demonstrated ability to evaluate generative AI, large language models, and agentic AI systems.
  • Demonstrated proficiency in Python and SQL, or comparable analytical tools, for independent testing and validation of statistical, machine-learning, and AI solutions.
  • Excellent written and communication skills and ability to create and maintain quality model documentation.
  • Ability to collaborate effectively and follow-up to ensure achievement of deadlines, outcomes, and results.
  • Effectively communicate model findings to model owners and developers
  • Ability to work independently and self-motivate in a fast-paced and rapidly changing environment.
Preferred
  • Master’s degree or Ph.D. in Artificial Intelligence, Machine Learning, Computational Science, Engineering, Statistics, Mathematics, Economics, or related Quantitative field is required, and 4+ years of work-related experience in an analytics role, with a minimum of 3 years of model development/model validation experience in financial services, banking, or retail etc. with 1+ years focused on GenAI and/or agentic AI.
  • Experience with AI/ML evaluation frameworks and LLM testing tools used to assess generative AI and agentic AI systems.
  • Experience validating behavioral, credit, fraud, or other financial-services models developed using advanced analytics, machine learning, or AI.
  • Familiarity with AI governance frameworks and emerging regulatory expectations.
  • Experience leading complex validation projects, developing actionable plans, and delivering results within established timelines.
  • Experience supporting regulatory examinations, internal audits, or model-risk governance reviews.
  • Strong knowledge of current model risk management guidance, including SR 26-2 and OCC Bulletin 2026-13, as well as AI-specific governance and supervisory expectations under the OCC Supervision Intelligence Framework.
  • Experience in people and project management, including demonstrated ability to develop actionable plans to meet high level objectives, strong execution, and timeline sensitive deliverables.

Credit One Bank, N.A. is a data-driven financial services company based in Las Vegas. Founded in 1984, Credit One Bank offers a spectrum of credit card products for people in all stages of financial life. Credit One Bank is an equal opportunity employer committed to diversity and inclusion and does not discriminate against any employee or applicant for employment because of age, race, religion, color, disability, sex, sexual orientation, or national origin. Reasonable accommodations can be made for those who require them, including access to job applications and workplace accommodations. Employment at Credit One Bank is based on mutual consent (also known as at-will). This means that employees and the Bank may terminate the employment relationship at any time, with or without cause and with or without notice. Credit One Bank does not accept unsolicited resumes from agencies and is not responsible for related fees.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AVP, Artificial Intelligence
AVP, Artificial Intelligence

Credit One Bank • Las Vegas (NV)

On-site
USD 180,000 - 260,000
Credit - Risk Modeler III - P3
Credit - Risk Modeler III - P3

Credit One Bank • Las Vegas (NV)

On-site
USD 120,000 - 180,000
Senior GenAI & ML Model Validation Lead
Senior GenAI & ML Model Validation Lead

Credit One Bank • Las Vegas (NV)

On-site
USD 120,000 - 190,000
Model Validation 2nd LOD Lead Analyst
Model Validation 2nd LOD Lead Analyst

Citigroup Inc. • Wilmington (DE)

Hybrid
USD 173,000 - 174,000
Manager, Data Science - Model Risk Office
Manager, Data Science - Model Risk Office

Capital One Group • Chicago (IL)

On-site
USD 179,000 - 205,000
Vice President – Generative AI Technical Expert, Data Science & Artificial Intelligence — Hybrid
Vice President – Generative AI Technical Expert, Data Science & Artificial Intelligence — Hybrid

Citi Group • New York (NY)

On-site
USD 157,000 - 236,000
Data Analyst Manager - Model Risk Office
Data Analyst Manager - Model Risk Office

Capital One Group • Chicago (IL)

On-site
USD 149,800 - 171,000
Comprehensive health benefits
Performance-based incentive compensation
Opportunity for sponsorship for employment authorization
Senior Associate, Data Scientist - Model Risk Office
Senior Associate, Data Scientist - Model Risk Office

Capital One Group • Chicago (IL)

On-site
USD 123,000 - 141,000
VP II, Software Engineering (Communications)
VP II, Software Engineering (Communications)

Credit One Bank • Las Vegas (NV)

On-site
USD 180,000 - 300,000
Manager, Data Scientist - Model Risk Office
Manager, Data Scientist - Model Risk Office

Capital One Group • McLean (VA)

On-site
USD 197,300 - 225,100
Comprehensive health benefits
Performance-based incentives
Inclusive company culture