Operations & Finance Domain Expert — AI Benchmark Problem Author

Toptal

United Kingdom

On-site

GBP 90,000 - 130,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Toptal is seeking senior practitioners to craft PhD-level problems in Operations, Claims, Compliance, Supply Chain, Logistics, or Marketing Econometrics for AI benchmarking. You contribute expert domain insight without needing to code; a reviewer will translate your work into executable tasks on Linux systems.

Your depth and precise communication ensure problems have a unique correct solution and reveal where today's AI tools struggle. You’ll coordinate with a technical reviewer as needed.

Qualifications

  • 9+ years of professional experience in at least one of: Operations, Claims (including medical claims), Compliance, Supply Chain, Logistics, or Marketing Econometrics.
  • Expert-level, PhD-caliber depth in your specialty — you know where the hard, non-obvious problems live.
  • Experience with data-driven, computational work in your field (e.g., large claims datasets, inventory or network optimization, regulatory testing, marketing-mix models)
  • Precise written communication: you can specify a problem so tightly that only one answer is correct

Responsibilities

  • Create one very hard, original problem at a time within your assigned domain (and subdomain, where one is given)
  • Design problems that genuinely need a computer — solved by running commands or scripts on a Linux machine, not by hand or with a calculator
  • Ensure each problem has one clear, objectively correct answer that a program can mark right or wrong, so two experts working independently reach the same result
  • Confirm that leading AI tools fail to solve your problem
  • Stay within your assigned field, and flag any task outside your comfort zone through the support channel rather than forcing it

Skills

Operational domain expertise
Claims / medical claims
Compliance
Supply Chain / Logistics
Marketing Econometrics

Education

PhD-level depth

Tools

SQL
Python
R

Job description

A leading AI data company is building a benchmark of expert-written problems that test whether frontier AI agents can solve hard, real-world problems on a computer. We're looking for senior practitioners in Operations, Claims (including medical claims), Compliance, Supply Chain, Logistics, and Marketing Econometrics to design PhD-level problems drawn from their own field — the kind of problem that today's best AI tools still get wrong.

You bring the domain expertise; you don't need to be a programmer. After you submit a problem, a technical reviewer builds the code files from your work.

What You'll Do
  • Create one very hard, original problem at a time within your assigned domain (and subdomain, where one is given)
  • Design problems that genuinely need a computer — solved by running commands or scripts on a Linux machine, not by hand or with a calculator
  • Ensure each problem has one clear, objectively correct answer that a program can mark right or wrong, so two experts working independently reach the same result
  • Confirm that leading AI tools fail to solve your problem
  • Stay within your assigned field, and flag any task outside your comfort zone through the support channel rather than forcing it
What You Bring
  • 9+ years of professional experience in at least one of: Operations, Claims (including medical claims), Compliance, Supply Chain, Logistics, or Marketing Econometrics
  • Expert-level, PhD-caliber depth in your specialty — you know where the hard, non-obvious problems live
  • Experience with data-driven, computational work in your field (e.g., large claims datasets, inventory or network optimization, regulatory testing, marketing-mix models)
  • Precise written communication: you can specify a problem so tightly that only one answer is correct
Nice to Have
  • Hands-on experience with SQL, Python, R, or similar analytical tools
  • Prior experience writing benchmarks, evaluation tasks, or expert problems for AI labs
  • An advanced degree (MS, MBA, PhD) or professional certification in your domain (e.g., APICS/ASCM, CPC/CCS, CRCM/CAMS, CFA)
  • Experience reviewing or quality-checking other experts' technical work
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Problem Author, Computational AI Benchmarks
Expert Problem Author, Computational AI Benchmarks

Toptal • United Kingdom

Remote
GBP 100,000 - 150,000
Operations & Finance AI Benchmark Problem Architect
Operations & Finance AI Benchmark Problem Architect

Toptal • United Kingdom

On-site
GBP 90,000 - 130,000
Cs Benchmark Expert - Fully Remote | Upto $84/Hr
Cs Benchmark Expert - Fully Remote | Upto $84/Hr

Mercor • United Kingdom

Remote
GBP 69,000 - 88,000
Healthcare & Medical Expert
Healthcare & Medical Expert

Anyone AI • Greater London

Remote
GBP 31,000 - 62,000
Business Administration (MBA) - AI Content Specialist
Business Administration (MBA) - AI Content Specialist

Alignerr Corp. • Oxford

Remote
GBP 42,000 - 83,000
Applied AI ML Director
Applied AI ML Director

Testing Site - JPMC • Greater London

On-site
GBP 120,000 - 180,000
Senior AI Solutions Engineer
Senior AI Solutions Engineer

Randstad Technologies Recruitment • City Of London

On-site
GBP 120,000 - 180,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft • Greater London

On-site
GBP 90,000 - 130,000
Business Administration (MBA) - AI Content Specialist
Business Administration (MBA) - AI Content Specialist

Alignerr Corp. • Greater London

Remote
GBP 30,000 - 69,000
Fully remote
Flexible schedule
Contract-based
AI Solutions Engineer
AI Solutions Engineer

DGH Recruitment Limited • City Of London

On-site
GBP 70,000 - 100,000