AI Experience Strategist & Evaluation Analyst

R/GA; New York; On-site; GBP 50,000 - 80,000; Full time

Job summary

R/GA is seeking an early-career strategist or analyst to join its London team, working at the intersection of experience strategy, audience research, measurement and AEO. You will handle audience discovery, testing, and evaluation across digital products and AI-driven experiences.

You'll contribute to turning insights into product recommendations, build evaluation dashboards and help ensure brand signals are accurately reflected in AI outputs.

Qualifications

• Experience in research, analytics, measurement or marketing sciences, with exposure to AI products or evaluation is a plus.
• Strong ability to analyse data and translate insights into product recommendations.
• Interest in how audience insight informs strategy and decision making.

Responsibilities

• Pull Together Audience Research: Gather and synthesize market research and user insights to build personas and understand user intent.
• Run AEO Audits: Conduct Answer Engine Optimisation audits, documenting gaps where AI reads or misreads content.
• Support Experience Strategy: Translate insights into product recommendations and participate in ideation sessions for new features.
• Score AI Outputs: Apply rubrics to evaluate outputs for accuracy and brand alignment.
• Assist with Testing: Set up synthetic tests and analyse results to surface edge cases and patterns.
• Work with Structured Data: Map brand content to JSON-LD schemas for machine readability.
• Track Operational Metrics: Monitor latency, cost, accuracy and hallucination rate against benchmarks.
• Build Dashboards & Scorecards: Create dashboards and draft initial findings for clients.
• Review System Behaviour: Check outputs against evaluation results to ensure brand signal is present.
• Prepare Reporting: Turn data into clear visuals and summaries for stakeholders.
• Collaborate Broadly: Work with data engineering, creative and technology teams to align on 'good'.

Skills

Audience research

Measurement

AEO

SQL

Python

Structured data

Tools

SQL

Python

JSON-LD

LangSmith

Arize

LangChain

Job description

R/GA is seeking an early-career strategist or analyst to join its London team, working at the intersection of experience strategy, audience research, measurement and AEO. You will handle audience discovery, testing, and evaluation across digital products and AI-driven experiences.

You'll contribute to turning insights into product recommendations, build evaluation dashboards and help ensure brand signals are accurately reflected in AI outputs.