Remote Financial AI Evaluator & Quality Tester

CNTXT AI; New York (NY); On-site; USD 48,216 - 96,432; Full time

Job summary

CNTXT AI is seeking a remote contractor to evaluate AI-generated financial content and develop test cases that probe analytical reasoning. You will help improve how AI models handle financial information with clear explanations and rigorous checks.

Responsibilities include assessing accuracy across banking, insurance, accounting and risk management; identifying methodological errors; cross-referencing data from balance sheets and reports; creating prompts and Excel-based evaluation tasks; and

Qualifications

• Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field.
• Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management.
• Ability to explain complex financial concepts clearly and accurately in writing.
• Full professional English proficiency.
• Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow.

Responsibilities

• Evaluate AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles.
• Identify errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing.
• Assess AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records.
• Develop prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks.
• Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt.

Skills

Analytical reasoning

Written communication

English proficiency

Remote work discipline

Education

Bachelor's degree in Finance/Accounting/Economics/Business

Tools

Excel

Job description

CNTXT AI is seeking a remote contractor to evaluate AI-generated financial content and develop test cases that probe analytical reasoning. You will help improve how AI models handle financial information with clear explanations and rigorous checks.

Responsibilities include assessing accuracy across banking, insurance, accounting and risk management; identifying methodological errors; cross-referencing data from balance sheets and reports; creating prompts and Excel-based evaluation tasks; and