AI Quality & Risk Analyst — Credit AI Ops

FICO; United States; Remote; USD 105.000 - 165.000; Vollzeit

Zusammenfassung

FICO is seeking an AI Operations Analyst for the Scores B2C team. You will review AI-driven conversations, flag inaccuracies, and help improve product safety. You will work with Product, AI engineers, and QA to refine rubrics and sampling methods, using SQL and Tableau to understand user queries and quality trends.

The role emphasizes data labeling, rubric consistency, and escalation processes, with responsibilities to publish weekly quality reports and support fixes after releases.

Qualifikationen

• Bachelor's degree or equivalent experience in a related field.
• Strong SQL skills and ability to read dashboards in Tableau.
• Detail oriented with ability to apply a rubric consistently.

Aufgaben

• Review AI chat conversations and product summaries for accuracy and safety.
• Categorize feedback and guardrail blocks into a taxonomy and track changes over time.
• Label data to support evaluation of automated reviewers and measure agreement.

Kenntnisse

SQL

Dashboard review

Attention to detail

Ausbildung

Bachelor's degree in related field

Tools

Tableau

Python

Jobbeschreibung

FICO is seeking an AI Operations Analyst for the Scores B2C team. You will review AI-driven conversations, flag inaccuracies, and help improve product safety. You will work with Product, AI engineers, and QA to refine rubrics and sampling methods, using SQL and Tableau to understand user queries and quality trends.

The role emphasizes data labeling, rubric consistency, and escalation processes, with responsibilities to publish weekly quality reports and support fixes after releases.