Finance SME for AI Model Evaluation

Mercor; San Francisco (CA); Remote; USD 150,000 - 190,000; Full time

Job summary

Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks.

Candidates should bring 8+ years in finance and proven ability to engage with cross-functional teams, with a commitment to approximately 35 hours per week across weekdays.

Qualifications

• 8+ years of dedicated professional experience in finance at a top-tier organization.
• Hands-on experience evaluating AI model outputs against rubrics or scoring criteria.
• Demonstrated career progression and reliability in a finance role.

Responsibilities

• Guide research and engineering teams to improve financial reasoning and decision-making.
• Design finance tasks and write well-reasoned solutions grounded in practice.
• Evaluate AI outputs against rubrics and provide written feedback on correctness.
• Develop evaluation guidelines and scoring rubrics for finance tasks.
• Collaborate with other SMEs to ensure accuracy in training data.

Skills

Finance expertise

AI model evaluation

Communication skills

Team collaboration

Job description

Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks.

Candidates should bring 8+ years in finance and proven ability to engage with cross-functional teams, with a commitment to approximately 35 hours per week across weekdays.