AI Measurement Architect: Reliable, Reproducible Analytics

Broadcastwell LLC

Northern (KY)

Hybrid

USD 90,000 - 120,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Broadcastwell LLC is seeking a role focused on reliability and reproducibility of measurement for AI-driven buyer questions. You will own scoring rules, design repeatable measurement runs, curate datasets and analysis, and decide when results are publishable while noting limitations. You will also review client measurements before delivery to clients.

The position emphasizes rigorous methodology, traceability, and transparent documentation to support published research volumes.

Responsibilities

  • Own the scoring rules applied to every observed answer, and keep them written down on the methodology page.
  • Design how each measurement run is recorded so every citation traces back to the answer it came from.
  • Turn research requirements into a measurement design the team can repeat on the next volume.
  • Prepare the datasets and analysis deposited with each published research volume.
  • Decide when a result is solid enough to publish and when a limitation has to be stated beside it.
  • Review client measurement before findings reach the client.

Job description

Broadcastwell LLC is seeking a role focused on reliability and reproducibility of measurement for AI-driven buyer questions. You will own scoring rules, design repeatable measurement runs, curate datasets and analysis, and decide when results are publishable while noting limitations. You will also review client measurements before delivery to clients.

The position emphasizes rigorous methodology, traceability, and transparent documentation to support published research volumes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Solutions Architect
AI Solutions Architect

Broadcastwell LLC • Northern (KY)

Hybrid
USD 90,000 - 120,000
Remote AI Measurement Architect: Reproducible Metrics
Remote AI Measurement Architect: Reproducible Metrics

Work From Anywhere • Northern (KY)

Hybrid
USD 140,000 - 190,000
Remote AI Measurement Architect — LLM Evaluation
Remote AI Measurement Architect — LLM Evaluation

Remote Jobs • United States

Remote
USD 140,000 - 190,000
AI Solutions Architect
AI Solutions Architect

Work From Anywhere • Northern (KY)

Hybrid
USD 140,000 - 190,000
AI Solutions Architect
AI Solutions Architect

Remote Jobs • United States

Remote
USD 140,000 - 190,000
AI Automation Engineer: Build Repeatable Workflows
AI Automation Engineer: Build Repeatable Workflows

Broadcastwell LLC • Northern (KY)

Hybrid
USD 90,000 - 130,000
AI Automation Engineer
AI Automation Engineer

Broadcastwell LLC • Northern (KY)

Hybrid
USD 90,000 - 130,000
AI Automation Engineer
AI Automation Engineer

Remote Jobs • United States

Remote
USD 110,000 - 150,000
AI Benchmarking & Strategy Lead
AI Benchmarking & Strategy Lead

Artificial Analysis • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Competitive compensation
AI Reliability Lead: Build Trustworthy, High-Quality AI
AI Reliability Lead: Build Trustworthy, High-Quality AI

PowerToFly • Eagan (MN)

Hybrid
USD 91,000 - 169,000
Hybrid work model
Flexible vacation
Mental health days