Remote Finance & Accounting SME - Rubric & AI Evaluation

SuperAnnotate AI, Inc.; United States; Remote; USD 83,000 - 138,000; Full time

Job summary

SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, seeks a remote Finance & Accounting SME contractor to create realistic financial tasks, evaluate AI-generated work, and design detailed rubrics guiding high-quality responses.

You will develop challenging questions across financial analysis, accounting, corporate finance, valuation, and risk, translating judgments into structured criteria covering accuracy, assumptions, and reasoning.

Qualifications

• Bachelor’s degree or higher in Finance, Accounting, Economics, Business, Applied Mathematics, or a related discipline.
• Certifications such as CPA, CFA, ACCA, ACA, CMA, FRM or equivalent are strongly preferred where applicable.

Responsibilities

• Create professional finance tasks: Develop challenging financial, accounting, valuation, investment, audit, or analytical problems.
• Design scoring rubrics: Define the calculations, assumptions, reasoning, and professional considerations expected in strong responses.
• Evaluate financial outputs: Review AI-generated analyses for accuracy, methodology, logic, and completeness.
• Assess professional judgment: Determine whether assumptions and conclusions are reasonable and sufficiently supported.
• Identify material errors: Detect incorrect calculations, accounting treatment, valuation logic, financial interpretation, or risk analysis.
• Critique peer rubrics: Review criteria for ambiguity, missing components, duplication, excessive subjectivity, or technical errors.
• Develop reference content: Produce high-quality analyses, solutions, critiques, and explanations.
• Support AI training: Generate tasks, rubrics, evaluations, preferences, and reference-answer pairs suitable for RL and SFT.
• Maintain professional standards: Ensure outputs reflect appropriate finance and accounting conventions and terminology.

Skills

Finance

Accounting

Corporate finance

Investment analysis

Financial Modeling

Valuation

Audit

Financial Reporting

English

Expert Review

Model Evaluation

Professional Judgment

Rubric writing

Rubric Design

AI Evaluation

Risk Management

Education

Bachelor’s degree or higher in Finance/Accounting

Job description

SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, seeks a remote Finance & Accounting SME contractor to create realistic financial tasks, evaluate AI-generated work, and design detailed rubrics guiding high-quality responses.

You will develop challenging questions across financial analysis, accounting, corporate finance, valuation, and risk, translating judgments into structured criteria covering accuracy, assumptions, and reasoning.