Remote Part-Time AI Financial Risk & Safety Evaluator

mpathic; United States; Remote; USD 41,000 - 276,000; Part time

Job summary

mpathic is seeking part-time Financial Experts to support red-teaming and QA campaigns focused on evaluating AI system behavior in consumer-facing financial interactions.

You will review AI responses and multi-turn conversations to identify risks related to financial guidance, overconfidence, and communication of uncertainty. This is not financial advising but evaluation and adversarial testing of AI outputs.

Qualifications

• Professional experience in finance, investment analysis, or financial advising.
• Experience in banking, wealth management, or asset management is a plus.
• Understanding of financial risk, uncertainty, and decision-making.
• Ability to identify overconfidence, misleading claims, or missing risk disclosures.
• Interest in red teaming, adversarial testing, or safety evaluation of AI systems.

Responsibilities

• Review AI-generated financial content and conversations for accuracy and risk.
• Identify unsafe or misleading financial guidance.
• Evaluate how AI systems handle uncertainty and disclosures.
• Assess whether models challenge risky or incorrect user assumptions.
• Identify patterns of sycophancy, over-alignment, or inappropriate agreement.
• Document edge cases and emerging risk patterns.
• Provide structured feedback to internal teams.

Skills

Finance

Investment analysis

Financial advising

Regulatory knowledge

Tools

Slack

Job description

mpathic is seeking part-time Financial Experts to support red-teaming and QA campaigns focused on evaluating AI system behavior in consumer-facing financial interactions.

You will review AI responses and multi-turn conversations to identify risks related to financial guidance, overconfidence, and communication of uncertainty. This is not financial advising but evaluation and adversarial testing of AI outputs.