Loan Operations QA Analyst — AI/Gen AI Validation

Crisil; Bogotá; On-site; COP 70,000,000 - 110,000,000; Full time

Job summary

CRISIL, a global analytics company, is seeking a QA analyst to evaluate model-generated outputs against source notices and business rules within the AI/ML Evaluation and Quality Assurance Team. The role focuses on identifying extraction errors, documenting quality gaps and providing feedback to improve model performance.

As part of the team, you will verify outputs, maintain validation records, and work with Technology and Loan Operations to resolve queries, ensuring outputs align with daily

Qualifications

• Graduate with relevant experience in loan servicing and validation.
• Experience with UAT testing, test case design, and defect tracking is preferred.
• Strong understanding of agency, bilateral and syndicated loan notices and classification.

Responsibilities

• Evaluate AI/ML outputs against source notices and predefined rules.
• Perform systematic quality checks and maintain validation records.
• Provide detailed validation feedback to Tech/Gen AI teams to refine extraction logic.
• Collaborate with Technology and Loan Operations to resolve queries and align outputs with business expectations.
• Support integration of proprietary notice management tools with Gen AI through UAT and defect logging.

Skills

Loan IQ

Flex-cube

ACBS

Clear Par

UAT testing

Education

Bachelor's degree

Tools

Loan IQ

Flex-cube

ACBS

Clear Par

Job description

CRISIL, a global analytics company, is seeking a QA analyst to evaluate model-generated outputs against source notices and business rules within the AI/ML Evaluation and Quality Assurance Team. The role focuses on identifying extraction errors, documenting quality gaps and providing feedback to improve model performance.

As part of the team, you will verify outputs, maintain validation records, and work with Technology and Loan Operations to resolve queries, ensuring outputs align with daily