Applied AI Researcher - LLM Agents & Evaluation

Improbable; United Kingdom; On-site; GBP 70,000 - 120,000; Full time

Job summary

Improbable is seeking an AI Researcher to lead the design and evaluation of agents that perform real work reliably and usefully. You will design experiments, build an evaluation framework, and translate research findings into actionable product direction.

The role emphasizes turning research into working prototypes and shaping the roadmap for Bolter as it grows. You should have a track record in applied AI/ML research, strong experimental design, engineering fundamentals, and deep familiarity

Responsibilities

• Design and run experiments to test how Bolter's agents behave - reliability, context retention, multi-step task completion, and where they fail.
• Build and own the evaluation layer. Design evals that measure whether agents actually do the work, not just whether they sound plausible.
• Research the frontier. Keep Bolter current on the state of the art in LLM agents, tool use, and reliability - and translate that into what we should build.
• Turn findings into decisions. You produce clear, actionable recommendations the engineering team can ship, not just papers.
• Prototype research into product. Take promising ideas from experiment to working prototype, and hand off what proves useful.
• Shape the research roadmap as Bolter grows.

Job description

Improbable is seeking an AI Researcher to lead the design and evaluation of agents that perform real work reliably and usefully. You will design experiments, build an evaluation framework, and translate research findings into actionable product direction.

The role emphasizes turning research into working prototypes and shaping the roadmap for Bolter as it grows. You should have a track record in applied AI/ML research, strong experimental design, engineering fundamentals, and deep familiarity