Model Validation Consultant

Relha LLC; Northern (KY); Hybrid; USD 87,000 - 171,000; Full time

Job summary

Deloitte is seeking a Regulatory & Financial Risk - Model Validation Consultant to join our team in the United States. You will validate AI/GenAI/Agentic AI solutions across client engagements, executing validation plans, testing, and documentation to assess risk management and responsible AI deployment.

You will review model design, data use, and performance, contributing to automated validation processes and client-ready materials.

Qualifications

• Undergraduate degree in Computer Science, Data Science, Artificial Intelligence, Applied Mathematics, or related field.
• 2+ years of experience using Python to develop, test, and maintain code.
• 2+ years of experience with Generative AI frameworks and components such as Hugging Face, OpenAI APIs, Llama models, Gemini, Claude, Granite, retrieval-augmented generation (RAG), or Stable Diffusion.
• 1+ years of experience with Agentic AI frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI.
• 2+ years of experience using at least 1 deep learning framework such as PyTorch or TensorFlow/Keras.
• Experience building, testing, or deploying AI solutions on AWS, Azure, or GCP.
• Experience with containerization tools such as Docker or Kubernetes.
• Understanding of machine learning and deep learning methods, performance assessment, and model validation.
• Limited immigration sponsorship may be available.
• Ability to travel up to 15%, based on work and clients served.
• Preferred: Industry experience in Financial Services, Life Sciences, or Technology, Media, and Telecom.
• Experience supporting GenAI or Agentic AI solutions in production.
• Understanding of AI, GenAI, and Agentic AI risks, bias, mitigation approaches, and responsible use.
• Experience with deep learning model training.

Responsibilities

• Support end-to-end validation of AI, GenAI, and Agentic AI solutions across client engagements.
• Execute fit-for-purpose validation plans with testing, documentation, and traceability.
• Assess model design choices, data suitability, assumptions, limitations, and use cases.
• Evaluate model performance and stability using benchmarking, back-testing, sensitivity and stress testing.
• Validate GenAI/Agentic AI behaviors including guardrails, logging, and grounding checks.
• Document bias, fairness, explainability, robustness, privacy, and security considerations.
• Contribute to automated validation processes and evaluation pipelines.
• Track tasks and risks, supporting timely delivery of work.
• Prepare clear summaries of validation findings for clients.
• Collaborate with Deloitte specialists to strengthen validation approaches.

Skills

Python development

Generative AI frameworks

Agentic AI frameworks

Deep learning methods

Cloud experience (AWS/Azure/GCP)

Model validation & testing

Data science fundamentals

Education

Bachelor's degree in CS/Data Science/AI or related field

Tools

Docker

Kubernetes

Hugging Face

OpenAI APIs

Job description

Regulatory & Financial Risk - Consultant – Model Validation

Our Deloitte Regulatory, Risk & Forensic team helps client leaders translate multifaceted risk and an evolving regulatory environment into defensible actions that strengthen, protect, and transform their organizations. Join our team and use advanced data, AI, and emerging technologies with industry insights to help clients bring clarity from complexity and accelerate their path to value creation.

As a Model Validation Consultant within Regulatory & Financial Risk, you will support model validation work for AI, Generative AI (GenAI), and Agentic AI solutions across client engagements. You will execute validation activities, contribute to documentation and testing, and help teams assess model risk management practices and responsible AI deployment across industries such as Financial Services, Life Sciences, and Technology, Media, and Telecom.

Responsibilities include

Support end-to-end validation of AI, GenAI, and Agentic AI solutions, from initial review of objectives and data through production readiness and ongoing monitoring.

Execute fit-for-purpose validation plans, including testing, documentation, and traceability requirements aligned to broader AI risk management processes.

Assess model design choices, data suitability, assumptions, limitations, and intended use through structured review and testing.

Evaluate model performance and stability using appropriate methods such as benchmarking, back-testing where applicable, sensitivity testing, stress testing, error analysis, and scenario-based evaluation.

Support validation of GenAI and Agentic AI behaviors and controls, including response quality evaluation, hallucination and grounding checks for retrieval-augmented generation (RAG), prompt and tool-use testing, guardrails, escalation paths, and audit logging.

Assess trustworthiness considerations and document observations related to bias and fairness, explainability, robustness, privacy, security, and operational controls.

Contribute to automated processes for model validation, monitoring, and reporting, including test harnesses, evaluation pipelines, and documentation templates.

Contribute to project workplans by tracking tasks, identifying risks, and supporting timely delivery of assigned work.

Prepare clear summaries of validation findings and support development of materials for client stakeholders.

Collaborate with specialists across Deloitte to strengthen validation approaches and stay current on emerging AI methodologies.

Qualifications

Required:

Undergraduate degree in Computer Science, Data Science, Artificial Intelligence, Applied Mathematics, or a related field

2+ years of experience using Python to develop, test, and maintain code

2+ years of experience working with Generative AI frameworks and components such as Hugging Face, OpenAI APIs, Llama models, Gemini, Claude, Granite, retrieval-augmented generation (RAG), or Stable Diffusion

1+ years of experience working with Agentic AI frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI

2+ years of experience using at least 1 deep learning framework such as PyTorch or TensorFlow/KerasExperience building, testing, or deploying AI solutions on AWS, Azure, or GCP

Experience with containerization tools such as Docker or Kubernetes

Understanding of machine learning and deep learning methods, performance assessment, and model validation

Limited immigration sponsorship may be available

Ability to travel up to 15%, based on the work you do and the clients and industries/sectors you serve

Preferred:

Industry experience in Financial Services, Life Sciences, or Technology, Media, and Telecom

Experience supporting GenAI or Agentic AI solutions in production

Understanding of AI, GenAI, and Agentic AI risks, bias, mitigation approaches, and responsible use

Experience with deep learning model training

Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html

For individuals assigned and/or hired to work in Washington State, Deloitte is required by law to include a reasonable estimate of the compensation range for this role. This compensation range is specific to Washington State and takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $86,700 to $170,900.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Deloitte is committed to providing reasonable accommodations for people with disabilities. If you require a reasonable accommodation to participate in the recruiting process, please direct your inquiries to the Global Call Center (GCC) at [emailprotected] .

Our people and culture

Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ways of thinking, ideas, and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.

Our purpose

Deloitte’s purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities. Learn more.

From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship. From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career.

As used in this posting, ""Deloitte"" means Deloitte & Touche LLP, a subsidiary of Deloitte LLP. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. Certain services may not be available to attest clients under the rules and regulations of public accounting.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.