AI Solutions Architect

Broadcastwell LLC; Northern (KY); Hybrid; USD 90,000 - 120,000; Full time

Job summary

Broadcastwell LLC is seeking a role focused on reliability and reproducibility of measurement for AI-driven buyer questions. You will own scoring rules, design repeatable measurement runs, curate datasets and analysis, and decide when results are publishable while noting limitations. You will also review client measurements before delivery to clients.

The position emphasizes rigorous methodology, traceability, and transparent documentation to support published research volumes.

Responsibilities

• Own the scoring rules applied to every observed answer, and keep them written down on the methodology page.
• Design how each measurement run is recorded so every citation traces back to the answer it came from.
• Turn research requirements into a measurement design the team can repeat on the next volume.
• Prepare the datasets and analysis deposited with each published research volume.
• Decide when a result is solid enough to publish and when a limitation has to be stated beside it.
• Review client measurement before findings reach the client.

Job description

Broadcastwell measures how AI engines answer buyer questions, and everything the company sells depends on that measurement surviving being checked. This role owns the reliability and reproducibility of the measurement: clear scoring rules, traceable citations and datasets that readers can check.

• Own the scoring rules applied to every observed answer, and keep them written down on the methodology page.
• Design how each measurement run is recorded so every citation traces back to the answer it came from.
• Turn research requirements into a measurement design the team can repeat on the next volume.
• Prepare the datasets and analysis deposited with each published research volume.
• Decide when a result is solid enough to publish and when a limitation has to be stated beside it.
• Review client measurement before findings reach the client.