Financial AI Evaluator (Remote, Hourly Contractor)

CNTXT AI; New York (NY); Remote; USD 34,000 - 83,000; Part time

Job summary

CNTXT AI is seeking a remote, hourly contractor to evaluate AI-generated financial content and develop test cases that test analytical reasoning accuracy. You will help improve how AI models handle banking, insurance, accounting, and risk information with clear explanations and reliable analysis.

The role requires a bachelor’s degree in a finance-related field, at least one year of relevant experience, and strong written English. It offers flexible asynchronous work in a global context.

Qualifications

• Bachelor’s degree or higher in Finance, Accounting, Economics, Business, or closely related field.
• Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management.
• Ability to explain complex financial concepts clearly and accurately in writing.
• Full professional English proficiency.
• Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow.

Responsibilities

• Evaluate AI-generated financial content for factual accuracy and analytical soundness.
• Identify errors in financial methodology, misapplied regulations, and unsupported conclusions with source-backed corrections.
• Cross-reference data across balance sheets, reports, and operations to assess AI reasoning.
• Develop prompts and test cases for AI performance on financial operations and data analysis.
• Rate and compare AI responses based on correctness and prompt adherence.

Skills

English proficiency

Explain financial concepts in writing

Remote work discipline

Education

Bachelor’s degree or higher in Finance/Accounting/Economics/Business

Job description

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

• Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

• Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

• Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

• Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

• Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

• Bachelor’s degree or higher in Finance, Accounting, Economics, Business, or a closely related field

• Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

• Ability to explain complex financial concepts clearly and accurately in writing

• Full professional English proficiency

• Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

• Prior experience with AI data training, annotation, or model evaluation

• Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.