Financial LLM Subject Matter Expert

Crisil; Gurugram District; On-site; INR 600,000 - 800,000; Full time

Job summary

A leading financial services firm in Gurugram is seeking a Financial LLM Subject Matter Expert. The role involves collaborating on financial product evaluations and providing insights on the use of large language models. Ideal candidates will have experience in investment banking or asset management and a strong understanding of user expectations. This is an entry-level full-time position that offers the opportunity to contribute to innovative financial solutions within an established firm.

Qualifications

• Experience in one of the target industries like Investment Banking or Asset Management.
• Strong grasp of expectations from end users.
• Ability to create evaluation sets and expert human feedback.

Responsibilities

• Collaborate on financial product evaluations and research-oriented projects.
• Create workflows illuminating the application of LLMs.
• Write role-based evaluation questions for benchmarking LLM performance.

Skills

Knowledge of financial product evaluation

Experience with unstructured information retrieval

Familiarity with U.S. Earnings Call Transcripts

Understanding of large language models

Strong insights into user workflows

Job description

Apply for the Financial LLM Subject Matter Expert role at Crisil.

2 days ago Be among the first 25 applicants

Background The Kensho team is always on the search for Subject Matter Experts to collaborate on financial product evaluation, or research-oriented projects involving large language models or their systematic parts. This need will continue to grow as we develop cutting-edge agentic and multi agentic solutions for S&P Global and external groups. Some tasks may require extreme familiarity with unstructured information retrieval from both U.S. Earnings Call Transcripts and U.S.-filed 10Ks, structured datasets that S&P sells, and a combination of the two. Unlike more traditional subject matter expert projects, the SME should bring insights into workflows and knowledge, while also having a strong grasp of what end users both want and expect. The best suited SMEs will most likely have experience in one of the Target Industries or Target Personas listed below:

• Target Industries: Investment Banks, Asset Management firms, Private Equity firms, Hedge Funds
• Target Personas: Investment Banking Associate/Analyst, Research Analyst (generalist or industry-specific), Equity Analyst, Portfolio Analyst, Market Intelligence or Strategy Analyst, Investment Strategists, Due Diligence Analysts, Investment Analyst/Researcher, Market Economists/Strategist, Capital Markets Economist

Potential Deliverables:

• Workflow write-ups: Illuminating where and when it’s appropriate to apply LLMs and how they may benefit from them.
• Evaluation Set creation: Typically, writing role/persona-based questions they would need to answer. These questions would be used to benchmark current LLM/agent performance, identify gaps in development, and inform AI scientists on system/solution architecture.
• Expert Human feedback: Once a solution is ready to be tested, getting expert annotations, comments, and grades is invaluable. This catches last minute bugs, aligns the system to expert expectations, and determines whether it’s polished enough to be put in front of S&P employees or external users.

Seniority level

• Entry level

Employment type

• Full-time

Job function

• Finance and Sales

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Crisil by 2x.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.