Loan Operations Analyst

Crisil; Bogotá; On-site; COP 70,000,000 - 110,000,000; Full time

Job summary

CRISIL, a global analytics company, is seeking a QA analyst to evaluate model-generated outputs against source notices and business rules within the AI/ML Evaluation and Quality Assurance Team. The role focuses on identifying extraction errors, documenting quality gaps and providing feedback to improve model performance.

As part of the team, you will verify outputs, maintain validation records, and work with Technology and Loan Operations to resolve queries, ensuring outputs align with daily

Qualifications

• Graduate with relevant experience in loan servicing and validation.
• Experience with UAT testing, test case design, and defect tracking is preferred.
• Strong understanding of agency, bilateral and syndicated loan notices and classification.

Responsibilities

• Evaluate AI/ML outputs against source notices and predefined rules.
• Perform systematic quality checks and maintain validation records.
• Provide detailed validation feedback to Tech/Gen AI teams to refine extraction logic.
• Collaborate with Technology and Loan Operations to resolve queries and align outputs with business expectations.
• Support integration of proprietary notice management tools with Gen AI through UAT and defect logging.

Skills

Loan IQ

Flex-cube

ACBS

Clear Par

UAT testing

Education

Bachelor's degree

Tools

Loan IQ

Flex-cube

ACBS

Clear Par

Job description

• CRISIL is a leading, agile and innovative global analytics company driven by its mission of making markets function better.
• It has delivered independent opinions, actionable insights, and efficient solutions to over 100,000 customers through businesses that operate from India, the US, the UK, Argentina, Colombia, Poland, China, Hong Kong and Singapore.
• It is majority owned by S&P Global Inc, a leading provider of transparent and independent ratings, benchmarks, analytics and data to the capital and commodity markets worldwide.

Experience

5+ years of experience in commercial lending, syndicated and bilateral loan servicing, with exposure to notice processing and UAT

Job Overview

As part of the AI/ML Evaluation and Quality Assurance Team, you will be responsible for evaluating model-generated outputs against the source information (i.e. client/agent notices), predefined business rules and expected results. The role focuses on assessing output accuracy, identifying extraction errors, documenting quality gaps and providing feedback to the Tech/Development team to improve model performance.

Job Duties

• Evaluate AI/ML-generated outputs against source notices, predefined business rules and expected results; assess whether the model has correctly identified, extracted and classified relevant information from the notice.
• Perform systematic quality checks against agreed validation criteria; verify the completeness, correctness and consistency of model outputs. Maintain structured validation records and ensure findings are traceable to the source notice.
• Provide detailed validation feedback to the Technology and Gen AI teams to help refine extraction logic, improve prompts and enhance event classification accuracy.
• Work closely with Technology and Loan Operations teams to resolve queries, validate event interpretations and provide clarifications, keeping system outputs aligned with business expectations and ensuring daily targets and deadlines are met.
• Support the client’s initiative to integrate their proprietary notice management tool with Gen AI through UAT testing, defect logging and re-testing across releases.

Qualification

Any graduate with relevant experience

Skills Required

• Proficient in tools such as Loan IQ, Flex-cube, ACBS, Clear Par, etc.
• Hands-on experience in servicing loans in Loan IQ, including processing of funding requests, payments, rollovers, fee and interest calculations, and reconciliation.
• Strong knowledge of agency, bilateral and non-agented syndicated loan notices (borrowing, rate-reset, interest, fee, repayment, amendment and similar notices) and ability to classify them based on loan servicing event type.
• Proven experience in UAT (test case design, execution, defect tracking and sign-off), with an understanding of AI/ML or Gen AI output validation is preferred

Personal Attributes/ Interpersonal Skills Required

• Independent and decisive mindset; strong analytical and problem-solving skills; a structured working style with passion for deep diving into problems.
• A team player with the ability to work to tight deadlines.
• Strong interpersonal and communication skills; ability to work effectively across teams, including with technology teams.
• Ability to independently investigate and analyse information and present conclusions.
• Strong attention to detail and a documentation-driven approach to quality and traceability.