Remote Finance AI Evaluator — Part-Time Consultant

24-Mag Llc; New York (NY); Remote; USD 72,000 - 215,000; Part time

Job summary

24-MAG LLC is offering a part-time consulting opportunity for experienced finance professionals to contribute domain expertise to advanced AI research and evaluation initiatives across areas such as capital markets, portfolio management, investment research, trading, quantitative finance, investment banking, private equity, corporate finance, accounting, and related disciplines.

Selected professionals will evaluate AI models on complex finance tasks, identify areas where model performance can be

Qualifications

• 2+ years of professional experience in finance.
• Backgrounds in capital markets, portfolio management, research, trading, or quantitative finance.
• Experience in investment banking, private equity, venture capital, or growth equity is relevant.
• Backgrounds in FP&A, accounting, financial consulting, and corporate-finance are welcome.
• Strong understanding of financial concepts and investment analysis.

Responsibilities

• Evaluate AI model performance on specialised finance topics.
• Identify areas where models demonstrate weak or incomplete reasoning.
• Assess outputs for financial accuracy and analytical quality.
• Apply domain-specific judgement to complex finance scenarios.
• Document recurring model limitations and improvement opportunities.
• Apply expertise to investment analysis and corporate-finance scenarios.
• Evaluate forecasting, revenue builds, and financial assumptions.
• Analyse asset-management and risk-management problems.
• Review transaction, deal, or M&A-related reasoning where relevant.
• Apply structured problem-solving to challenging financial tasks.
• Create evaluation rubrics for specialised finance capabilities.
• Define clear criteria for assessing model performance.
• Develop standards for complex financial reasoning tasks.
• Support benchmarking across different areas of finance.
• Refine evaluation methods based on observed model behaviour.
• Collaborate with AI researchers and other finance professionals.
• Contribute subject-matter expertise to training strategies.
• Help shape evaluation approaches for finance-focused AI systems.
• Provide feedback on benchmark design and task difficulty.
• Support iterative improvement of finance-oriented model capabilities.
• Explain complex financial reasoning clearly in written English.
• Provide concise rationale for evaluation decisions.
• Identify inaccurate assumptions or unsupported conclusions.
• Communicate domain‑specific feedback to interdisciplinary teams.
• Maintain consistent quality standards across assigned evaluations.

Skills

Finance experience

Investment analysis

Financial forecasting

Risk management

Written English

Education

MBA in Finance

CFA (adv.)

Tools

Excel

Financial modeling

Job description

24-MAG LLC is offering a part-time consulting opportunity for experienced finance professionals to contribute domain expertise to advanced AI research and evaluation initiatives across areas such as capital markets, portfolio management, investment research, trading, quantitative finance, investment banking, private equity, corporate finance, accounting, and related disciplines.

Selected professionals will evaluate AI models on complex finance tasks, identify areas where model performance can be