AI Product Analyst

Portfolio Group (Canada)

Greater London

On-site

GBP 80,000 - 85,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Portfolio Credit Control is seeking an AI Product Analyst to own product analytics for AI offerings across tax, HR, health & safety, and care. You’ll build dashboards and an evidence-based reporting framework for strategic decisions.

Based in London, you’ll work with a top-tier engineering team to shape what ships, not just report on it, while running the evaluation programme and data curation with domain experts.

Qualifications

  • Substantial experience as a product, data, or commercial analyst.
  • Strong hands-on SQL and Python skills with automated analysis ability.
  • Experience with AI/ML systems and measuring probabilistic models.

Responsibilities

  • Product Performance & Analytics: measure AI product performance and user engagement.
  • Observability Management: own production quality metrics and data drift tracking.
  • Dashboard Engineering: build and maintain daily analysis and dashboards.
  • Strategic Insight & Segmentation: analyse cohorts and trends to find patterns.
  • Evaluation Programme Ownership: define tests and analyse evaluation outputs.
  • Golden Dataset Curation: manage datasets and elicitation with experts.

Skills

SQL
Python
Product analytics
Stakeholder management

Job description

AI Product Analyst


Our client is building cutting-edge AI products for their customers and for colleagues across the group, in tax, HR, health and safety, and care. We can see that people use them; what we cannot yet see with any precision is how well they perform – for which clients, in which sectors, on which kinds of question – and therefore where to invest next.


This role answers that. You will own product analytics for our AI products: measuring performance across the dimensions that matter, building the reporting and dashboards the team and the business work from, and drawing out the insight that sits behind the figures. The purpose is to give the business a reliable evidence base for its decisions about where to invest.


You will also own the evaluation programme. Where analytics establishes how the product performs in the hands of real users, evaluation establishes whether a change is good enough to release. You will own the datasets the product is tested against and the analysis of what the results mean, working closely with our AI Domain & Workflow Specialist.


This is a fantastic opportunity to join a respected, fast-growing AI division based full-time out of our London office. You’ll work alongside a highly technical engineering team to shape what ships, rather than just describing it after the fact.


Day-to-Day Responsibilities


  • Product Performance & Analytics: Measure how our AI products perform across retrieval quality, correctness of output, and user engagement.



  • Observability Management: Own production quality observability, tracking metrics like thumbs-down rates, regeneration rates, task abandonment, and usage drift.



  • Dashboard Engineering: Build and maintain the daily analysis and dashboards the AI team relies on, working with engineers to instrument and capture missing data points.



  • Strategic Insight & Segmentation: Interrogate data using cohort comparison, trend analysis, and segmentation (by client type, subject matter, and question type) to identify high-material patterns and outliers.



  • Evaluation Programme Ownership: Define what gets tested, analyse evaluation outputs for regressions, and collaborate with engineers to integrate testing harnesses into the build pipeline.



  • Golden Dataset Curation: Build, version, and maintain curated sets of questions and known‑good answers, running elicitation sessions with subject‑matter experts to capture professional edge cases.



  • Cross-Functional Reporting: Translate complex findings into actionable recommendations for the Product Manager and Director to shape priorities and inform the broader roadmap.


About You

We’re looking for AI product analyst who combine strong technical knowledge with excellent communication skills, a proactive approach and a genuine focus on client service.


You’ll ideally have:



  • Substantial experience as a product, data, or commercial analyst, having owned end-to-end product measurement.



  • Strong hands‑on SQL and Python skills (or close equivalents), with the ability to construct your own automated analysis and dashboards completely independently.



  • Comfort working with AI or ML systems, possessing a firm understanding of why measuring probabilistic models differs from measuring deterministic products.



  • Exceptional stakeholder communication skills, specifically the ability to draw structured data requirements out of subject‑matter experts and hold evidence‑based recommendations in front of senior leaders.



  • Familiarity with advanced AI concepts (Desirable): Experience with RAG (Retrieval-Augmented Generation) systems, golden datasets, scoring, regression testing, or A/B experiment design.



  • Domain Exposure (Desirable): Prior experience in tax, HR, health and safety, care, or another regulated professional services environment.Salary & Benefits



  • Salary range from £80,000 – £85,000 per annum, with potential to increase depending on experience.

  • Full-time, Monday-to-Friday working hours.


Why Join?

This is a remarkable opening for an ambitious analyst who wants to define the metric framework for a scaling AI portfolio from scratch, rather than inheriting someone else’s legacy dashboards. You will work directly with in-house professional experts on high-stakes products where structural accuracy and correctness genuinely matter to the person on the other end. If you have the evidence-driven confidence to state clearly when something is not working, we would love to hear from you.


52242HA


INDLON


The Portfolio Group are acting on behalf of our client in recruiting for this position.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Graduate Data & AI Analyst – Digital Products & Low-Code Solutions
Graduate Data & AI Analyst – Digital Products & Low-Code Solutions

Pi Digital Solutions • Greater London

Hybrid
GBP 40,000 - 60,000
Training and mentorship
Hands-on experience with cloud tooling
Early client exposure
AI Product Analyst
AI Product Analyst

The Portfolio Group • City Of London

On-site
GBP 50,000 - 75,000
AI Solutions Analyst
AI Solutions Analyst

Y-Axis • Greater London

Hybrid
GBP 50,000 - 70,000
Data Analytics And Insights Manager
Data Analytics And Insights Manager

Interactive Investor • Ledston

Hybrid
GBP 54,000 - 66,000
Pension plan
Private medical insurance
25 Days Annual Leave
+2
Data Analytics and Insights Manager
Data Analytics and Insights Manager

Interactive Investor Plc • Manchester, Leeds

Hybrid
GBP 54,000 - 66,000
Group Personal Pension Plan – 8%? conf
Life Assurance
Private Medical Insurance
+5
AI Product Analytics Lead
AI Product Analytics Lead

Portfolio Group (Canada) • Greater London

On-site
GBP 80,000 - 85,000
Data Analytics And Insights Manager
Data Analytics And Insights Manager

Interactive Investor • Manchester

Hybrid
GBP 54,000 - 66,000
Group Personal Pension
Life Assurance
Private Medical Insurance
+5
AI Product Manager
AI Product Manager

Eliden • Greater London

On-site
GBP 70,000 - 90,000
Private healthcare, dental, and life insurance
30 days annual leave plus bank holidays
Annual performance-based bonus
+2
Product Analytics Lead
Product Analytics Lead

Matillion • Manchester

Hybrid
GBP 102,000 - 153,000
Company Equity
30 days holiday + bank holidays
5 days paid volunteering leave
+4
Analytics Manager
Analytics Manager

MRJ Recruitment • Greater London

Hybrid
GBP 80,000 - 110,000