Finance AI Specialist: LLM Evaluation & Training

Obsidian; San Francisco (CA); Remote; USD 140,000 - 230,000; Full time

Job summary

Cincinnatus LLC is recruiting for a finance SME to join a leading AI lab's GenAI team, evaluating model outputs against rubrics and guiding financial judgment in AI training data. This is a W-2 employment placement with the option to be placed at a premier AI Lab as part of the extended workforce.

The role emphasizes rigorous financial analysis, collaboration with researchers, and developing scoring guidelines, with a requirement of 35 hours per week on weekdays and a proven track record at top

Qualifications

• 8+ years of dedicated professional experience in finance at top-tier organizations.
• Hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria.
• Demonstrable career progression (Analyst → Associate → VP/Director).
• Availability to engage for at least 35 hours/week on weekdays.
• Verbal and written communication, problem-solving, and interpersonal skills.

Responsibilities

• Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making.
• Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice.
• Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
• Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks.
• Collaborate with other subject matter experts to ensure consistency and accuracy in training data.

Skills

Finance expertise

Model evaluation

Communication skills

Problem solving

Team collaboration

Job description

Cincinnatus LLC is recruiting for a finance SME to join a leading AI lab's GenAI team, evaluating model outputs against rubrics and guiding financial judgment in AI training data. This is a W-2 employment placement with the option to be placed at a premier AI Lab as part of the extended workforce.

The role emphasizes rigorous financial analysis, collaboration with researchers, and developing scoring guidelines, with a requirement of 35 hours per week on weekdays and a proven track record at top