Remote Retail Banking AI Evaluator & Benchmarking Specialist

OpenTrain AI, Inc.; United States; Remote; USD 114,000 - 162,000; Part time

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. seeks a remote contractor to review AI responses on retail banking products, operations, and compliance.

You will develop clear evaluation rubrics, assess model performance, and provide structured feedback to help improve AI training and benchmarks. Requirements include at least two years in retail or consumer banking, with strong knowledge of deposits, payments, onboarding, and regulatory frameworks.

Qualifications

• At least two years in retail or consumer banking (including personal banking, branch management, or operations).
• Strong knowledge of deposit and payment products, onboarding, due diligence, and consumer banking regulations.

Responsibilities

• Review AI responses about retail banking scenarios (checking/savings, CDs, payments, overdrafts, fees, digital banking).
• Create evaluation rubrics for accuracy, consistency, and compliance.
• Rate model performance and provide structured feedback for training and benchmarks.
• Collaborate with researchers and banking experts on evaluation plans and methodologies.

Skills

Retail banking knowledge

Consumer banking

Written English proficiency

Rubric creation

Model evaluation

Clear communication

Job description

OpenTrain AI, Inc. seeks a remote contractor to review AI responses on retail banking products, operations, and compliance.

You will develop clear evaluation rubrics, assess model performance, and provide structured feedback to help improve AI training and benchmarks. Requirements include at least two years in retail or consumer banking, with strong knowledge of deposits, payments, onboarding, and regulatory frameworks.