AI/ML Risk Model Testing Lead & Validation

Marktine Technology Solutions Pvt. Ltd.; United States; Remote; USD 150,000 - 230,000; Full time

Job summary

Marktine Technology Solutions Pvt. Ltd. seeks an experienced AI/ML Testing & Validation expert for banking domains. You will design comprehensive test strategies, validate model outputs, and ensure regulatory alignment across PD, LGD, EAD, IFRS 9, and ECL risk areas.

You will collaborate with Risk, Data Science, Compliance, and IT teams to support model risk management, governance, and UAT, while advancing GenAI/LLM testing and RAG validation in production-ready pipelines.

Qualifications

• 10+ years in Banking Technology, Risk, or Digital Transformation.
• Minimum 5 years of experience testing or validating AI/ML models.
• Experience with Data Scientists and Model Risk teams; knowledge of governance.

Responsibilities

• Design and execute testing strategies for AI/ML models in banking applications.
• Validate model performance across training/validation/production datasets.
• Assess metrics like accuracy, precision, recall, F1, ROC-AUC.
• Perform end-to-end testing of AI-driven banking solutions and governance.

Skills

Banking domain

Credit risk

IFRS 9

Regulatory reporting

Lending lifecycle

Credit underwriting

Risk rating models

Fraud & AML

AI/ML

Machine learning lifecycle

Model validation

Explainable AI

Prompt engineering

GenAI testing

LLM evaluation

RAG validation

Hallucination detection

Confidence score validation

Bias & fairness testing

SQL

Python

Jupyter Notebook

Git

Azure DevOps / Jira

REST APIs

Snowflake

Databricks

MLflow

Tools

Selenium

Postman

PyTest

Great Expectations

Robot Framework

JMeter

API Testing

Data Validation Tools

Job description

Marktine Technology Solutions Pvt. Ltd. seeks an experienced AI/ML Testing & Validation expert for banking domains. You will design comprehensive test strategies, validate model outputs, and ensure regulatory alignment across PD, LGD, EAD, IFRS 9, and ECL risk areas.

You will collaborate with Risk, Data Science, Compliance, and IT teams to support model risk management, governance, and UAT, while advancing GenAI/LLM testing and RAG validation in production-ready pipelines.