Securities & Commodities Specialist

Agency; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

Agency is seeking a role focused on evaluating AI models for finance, trading, and market analysis. You will interact with language models on real-world and theoretical scenarios, ensuring factual accuracy and logical coherence.

The position requires strong knowledge of securities, derivatives, and regulatory considerations. The candidate will document model failures, trace issues, and propose improvements in prompts and evaluation metrics, while maintaining robust security and communications

Qualifications

• Expertise in securities, commodities, and financial services.
• Knowledge of investment strategies, risk management, derivatives, or regulatory compliance.
• Bachelor’s or master’s degree in finance, economics, business, or related field.
• Strong metacognitive communication—ability to show your work.

Responsibilities

• Converse with AI models on real-world trading scenarios and theoretical financial questions.
• Verify factual accuracy and logical soundness of model responses.
• Capture reproducible error traces and document model failure modes.
• Suggest improvements to prompt engineering and evaluation metrics.

Skills

Finance knowledge

Investment strategies

Risk management

Derivatives

Regulatory compliance

Metacognitive communication

Home office setup

Education

Bachelor’s or Master’s degree in finance/economics/business

Tools

Secure computer

High-speed internet

Job description

Responsibilities

• Converse with AI models on real-world trading scenarios and theoretical financial questions
• Verify factual accuracy and logical soundness of model responses
• Capture reproducible error traces and document model failure modes
• Suggest improvements to prompt engineering and evaluation metrics

Requirements

• Expertise in securities, commodities, and financial services
• Knowledge of investment strategies, risk management, derivatives, or regulatory compliance
• Bachelor’s or master’s degree in finance, economics, business, or a related field
• Strong metacognitive communication skills to "show your work"
• Ability to provide your own secure computer and high-speed internet

Preferred Qualifications

• Professional certifications such as CFA, FRM, or Series licenses
• Experience in trading floors, financial analysis, or compliance projects

About the Company

This project focuses on training large-scale language models to become powerful engines of financial insight and market analysis through high-quality expert data.