LLM Finance Evaluator - Remote Contractor

Weekday 1; United States; Remote; USD 90,000 - 124,000; Full time

Job summary

Weekday 1 is seeking experienced Finance Specialists to help shape next-gen AI models by evaluating outputs with structured rubrics. You will design finance tasks, create reference solutions, and assess performance with rigorous standards, drawing on 8+ years in finance across investment banking, asset management, or corporate finance.

This is a fully remote contractor role requiring 35+ hours weekly. Join a cutting-edge AI research initiative and collaborate with researchers to raise the bar on

Qualifications

• 8+ years of professional experience in finance, including investment banking, asset management, corporate finance or financial advisory.
• Mandatory: hands-on experience evaluating LLM/AI model outputs using structured rubrics or scoring frameworks.
• Demonstrated career progression and ability to commit at least 35 hours per week during weekdays.
• Strong analytical, problem-solving and financial reasoning skills, with excellent written and verbal communication.

Responsibilities

• Partner with research and engineering teams to improve AI models' understanding of financial reasoning and decision-making.
• Design real-world finance tasks and develop reference solutions based on industry best practices.
• Evaluate AI-generated outputs using structured rubrics and provide detailed feedback on accuracy and reasoning.
• Create evaluation frameworks, scoring guidelines, and quality standards for finance tasks.
• Collaborate with subject matter experts to ensure high-quality training data and consistency.
• Identify knowledge gaps and propose improvements to enhance AI performance across finance use cases.

Job description

Weekday 1 is seeking experienced Finance Specialists to help shape next-gen AI models by evaluating outputs with structured rubrics. You will design finance tasks, create reference solutions, and assess performance with rigorous standards, drawing on 8+ years in finance across investment banking, asset management, or corporate finance.

This is a fully remote contractor role requiring 35+ hours weekly. Join a cutting-edge AI research initiative and collaborate with researchers to raise the bar on