AI Quality Analyst: Finance Analytics & Benchmarking

The Centre for Global Equality

United Kingdom

Remote

GBP 35,000 - 50,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

The Centre for Global Equality in the United Kingdom is seeking a data-driven professional to join the analytics and quality team. You will analyze the performance of AI agents across finance-sector tasks, uncovering root causes of failure to drive improvements in design and evaluation.

Your responsibilities will include conducting statistical failure analysis, developing dashboards, and recommending enhancements based on data findings. A strong understanding of statistical analysis and proficiency in Python or R for data analytics are required.

Qualifications

  • Strong understanding of statistical analysis, hypothesis testing, and pattern recognition.
  • Proficiency in Python or R for data analytics.
  • Hands-on experience turning data into actionable insights.
  • Familiarity with AI/ML evaluation techniques.

Responsibilities

  • Conduct statistical failure analysis to identify patterns in AI agent performance.
  • Investigate root causes behind performance issues in task execution.
  • Perform multi-dimensional analysis across finance sub-domains.
  • Develop dashboards and reports highlighting performance trends.
  • Recommend enhancements to task design based on data findings.

Skills

Statistical analysis
Python (pandas, scipy, matplotlib/seaborn)
Exploratory data analysis (EDA)
AI/ML evaluation techniques
Excel
SQL
Visualization tools (Tableau, Looker)

Job description

The Centre for Global Equality in the United Kingdom is seeking a data-driven professional to join the analytics and quality team. You will analyze the performance of AI agents across finance-sector tasks, uncovering root causes of failure to drive improvements in design and evaluation.

Your responsibilities will include conducting statistical failure analysis, developing dashboards, and recommending enhancements based on data findings. A strong understanding of statistical analysis and proficiency in Python or R for data analytics are required.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Metrics & Model Evaluation Analyst
AI Metrics & Model Evaluation Analyst

Portfolio Credit Control • City Of London

On-site
GBP 80,000 - 85,000
AI Product Analytics Lead
AI Product Analytics Lead

Portfolio Credit Control • City Of London

On-site
GBP 80,000 - 85,000
AI Metrics & Model Evaluation Lead
AI Metrics & Model Evaluation Lead

The Portfolio Group • Greater London

On-site
GBP 80,000 - 85,000
AI Quality Engineer: Build Evaluation Frameworks & Automation
AI Quality Engineer: Build Evaluation Frameworks & Automation

iFindTech Ltd • Greater London

On-site
GBP 60,000 - 90,000
AI Metrics & Model Evaluation Lead
AI Metrics & Model Evaluation Lead

The Portfolio Group • City Of London

On-site
GBP 80,000 - 85,000
AI Quality Engineer — Hybrid, Equity & Unlimited Holidays
AI Quality Engineer — Hybrid, Equity & Unlimited Holidays

SoCode Recruitment • Greater London

Hybrid
GBP 70,000 - 90,000
Employee shares
Private health insurance
Unlimited holidays
+1
AI Finance Specialist: Prompting & Evaluation
AI Finance Specialist: Prompting & Evaluation

Great Value Hiring • United Kingdom

Hybrid
GBP 60,000 - 80,000
AI Solutions Lead — Data & Analytics
AI Solutions Lead — Data & Analytics

Equifax, Inc. • Greater London

On-site
GBP 45,000 - 65,000
Contributory pension
Life cover
Income protection
+2
AI Quality Specialist — Regulated QA for AI Systems (Hybrid)
AI Quality Specialist — Regulated QA for AI Systems (Hybrid)

Ideagen • Nottingham

Hybrid
GBP 45,000 - 65,000
Flexible work arrangements
AI Quality Assurance Lead: Testing & Standards
AI Quality Assurance Lead: Testing & Standards

Genpact (UK) Limited • Greater London

On-site
GBP 90,000 - 120,000