AI Model Validation Associate

BlackRock Services India Pvt Ltd; Gurugram District; On-site; INR 1,200,000 - 2,200,000; Full time

Benefits offered by this job

Retirement plan

Tuition reimbursement

Comprehensive healthcare

Support for working parents

Flexible Time Off

Job summary

BlackRock is seeking an Associate, AI Model Validation, RQA in Gurgaon to perform independent validation of AI tools and workflows. You will design test plans, define success criteria, review data quality, and assess risks across AI systems.

The role emphasizes collaboration with AI Engineering, Data Science, and Risk teams, with strong emphasis on governance and regulatory alignment. The ideal candidate has 3–7 years of IT or financial experience, a strong foundation in Python and AI libraries,

Qualifications

• 3–7 years of IT or financial industry experience.
• Degree or MS/PhD in Computer Science, Data Science, Statistics, Applied Mathematics, or related field.
• Strong understanding of generative AI technologies, including LLMs, RAG, agentic systems, prompt engineering, tool use, and modern AI app architectures.
• Experience with Python and AI libraries such as PyTorch or TensorFlow.
• Excellent analytical, communication, and documentation skills.
• Ability to work independently and challenge stakeholders constructively.

Responsibilities

• Conduct independent validation of AI usage in workflows, including testing for accuracy and guardrails.
• Design and implement validation strategies and test plans for each AI use case.
• Define success criteria and quality benchmarks for AI solutions.
• Review data quality, preprocessing steps, and engineering decisions for AI use cases.
• Execute functional and performance tests and document validation findings.

Skills

Generative AI

LLMs

RAG

Agentic systems

Prompt engineering

Memory management

Tool use

Python

Analytics

Education

MS/PhD in CS/Data Science/Statistics

Tools

PyTorch

TensorFlow

Job description

Associate, AI Model Validation, RQA

About this role

Business Overview

The Risk & Quantitative Analysis (RQA) group provides independent oversight of BlackRock’s fiduciary and enterprise risks. RQA’s principal objectives are to advance the firm’s risk management practices and to deliver independent risk expertise and constructive challenge to drive better business and investment outcomes. RQA is committed to investing in our people to increase individual enablement and ultimately build a stronger team. Our goal is to create a culture of inclusion which encourages collaboration, innovation, diversity and the development our future leaders. We actively engage in discussions on career growth and work with team members to understand how personal passions and strength connect with our purpose.

Role Description

The Enterprise Risk team within RQA oversees those risks which directly impact the corporate entity (i.e. BlackRock, Inc., or one of its subsidiaries), rather than the fiduciary risks assumed by funds/clients, such as investment risks and counterparty risks. The team’s focus includes but is not limited to operational risk, technology, vendor, model and market risk, stress testing for market risk and the quantitative estimation of capital adequacy requirements. The AI Validation Associate will perform independent reviews of AI tools and agents used across BlackRock, including agentic systems, RAG applications and other business workflows. This role requires strong technical expertise combined with risk management skills to challenge system design, data integrity, and performance monitoring. The role will be based onsite in our GGN office.

Key Responsibilities

Conduct independent validation of AI usage in workflows, including testing for accuracy, efficiency of guardrails, orchestration, memory management and token usage. Design and implement comprehensive validation strategies and test plans tailored to each AI use case. Define clear success criteria and quality benchmarks to measure whether the AI solution meets all requirements and standards. Understand tool architecture, potential vulnerabilities and weaknesses. Assess conceptual soundness, methodology, and alignment with intended business use. Review data quality, preprocessing steps and engineering decisions for AI use cases. Execute functional and performance tests. Evaluate performance metrics, robustness, and limitations under various scenarios. Document validation findings, provide recommendations. Stay current on emerging AI technologies, validation techniques, and regulatory developments. Communicate validation conclusions to relevant stakeholders, including escalating identified findings, risks or gaps to senior leadership and approval committees. Collaborate with AI Engineering, Data Science, and Risk teams to enhance AI transparency and trustworthiness.

Experience, Skills and Qualification

• With 3-7 years’ works experience in the IT or financial industry.
• Degree or Advanced degree (MS, PhD) in Computer Science, Data Science, Statistics, Applied Mathematics, or related field.
• Strong understanding of generative AI technologies, including large language models (LLMs), retrieval-augmented generation (RAG), agentic systems, prompt engineering, tool use, and modern AI application architectures.
• Experience with Python and common AI development libraries and frameworks (PyTorch, TensorFlow or similar).
• Excellent analytical, communication, and documentation skills.
• Ability to work independently and challenge stakeholders constructively.
• Experience with one or more of the following:
  • Validating usage of large language models (LLMs) in business context
  • Evaluation methodologies, benchmark development, ground-truth creation, and AI quality assessment
  • AI observability, monitoring, performance measurement, and operational controls
  • AI orchestration frameworks, agent architectures, prompt engineering, memory management, and context optimization
  • Exposure to cloud-based AI platforms and scalable model deployment MCP, APIs, connectors and integrations of AI solutions with enterprise systems and data sources
  • Responsible AI practices, including fairness, explainability, bias assessment, transparency, and model governance
  • Fine-tuning or model customization techniques
  • Security testing and risk assessment of AI systems, including prompt injection, jailbreak, and data leakage testing

Our benefits

To help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about.

Our hybrid work model

BlackRock’s hybrid work model is designed to enable a culture of collaboration and apprenticeship that enriches the experience of our employees, while supporting flexibility for all. Employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week. Some business groups may require more time in the office due to their roles and responsibilities. We remain focused on increasing the impactful moments that arise when we work together in person – aligned with our commitment to performance and innovation. As a new joiner, you can count on this hybrid model to accelerate your learning and onboarding experience here at BlackRock.

Guidance on AI use for candidates

At BlackRock, AI has long been part of how we work – enhancing decision-making, improving operations, and helping us deliver better outcomes for clients. We encourage candidates to use AI thoughtfully to learn, prepare, and work more effectively; but during our interview process, we want to focus on getting to know you through your own experiences, thinking, and judgment. To support you, we’ve provided guidance on when and how to use AI during our hiring process so you can approach each step with confidence and showcase your best self.

About BlackRock

At BlackRock, we are all connected by one mission: to help more and more people experience financial well-being. Our clients, and the people they serve, are saving for retirement, paying for their children’s educations, buying homes and starting businesses. Their investments also help to strengthen the global economy: support businesses small and large; finance infrastructure projects that connect and power cities; and facilitate innovations that drive progress. This mission would not be possible without our smartest investment – the one we make in our employees. It’s why we’re dedicated to creating an environment where our colleagues feel welcomed, valued and supported with networks, benefits and development opportunities to help them thrive. To learn more about BlackRock, please visit Careers.BlackRock.com . We also encourage you to get to know us on LinkedIn , Instagram , YouTube , X , and TikTok .

BlackRock is proud to be an Equal Opportunity Employer. We evaluate qualified applicants without regard to age, disability, family status, gender identity, race, religion, sex, sexual orientation and other protected attributes at law.

Experience Level

Mid Level