AI Researcher - Bolter

Improbable; Colombia; A distancia; COP 97.675.000 - 195.351.000; Jornada completa

Descripción de la vacante

Bolter is seeking an AI Researcher to design and run experiments that improve agent reliability and context management. You will prototype evaluations, translate findings into product decisions, and work with lean teams to ship results.

You'll explore state-of-the-art LLMs, tool use, and multi-step workflows, turning research into practical features while maintaining rigorous experimentation and clear communication with the engineering team.

Formación

• Applied AI/ML research experience with LLMs, agentic systems, or production AI reliability.
• Strong experimental design and data analysis capabilities.
• Solid engineering fundamentals to prototype experiments.
• Deep familiarity with LLMs, tool use, context management, and failure modes of agentic systems.
• Strong written communication.
• Ability to work with ambiguity and ship results.
• Experience leveraging AI agents as a force multiplier.
• Passion for craft and product-minded research.

Responsabilidades

• Design and run experiments to test how Bolter's agents behave — reliability, context retention, multi-step task completion, and where they fail.
• Build and own the evaluation layer. Design evals that measure whether agents actually do the work, not just whether they sound plausible.
• Research the frontier. Keep Bolter current on the state of the art in LLM agents, tool use, and reliability - and translate that into what we should build.
• Turn findings into decisions. You produce clear, actionable recommendations the engineering team can ship, not just papers.
• Prototype research into product. Take promising ideas from experiment to working prototype, and hand off what proves useful.
• Shape the research roadmap as Bolter grows.

Conocimientos

Applied AI/ML research

LLM applications

Experiment design

Engineering fundamentals

Written communication

Ambiguity tolerance

Agentic systems

Tool use

Descripción del empleo

Both short-term and permanent roles are possible.

About Bolter

Bolter is an AI agent platform built to help people get real work done, without needing to stitch together multiple tools or spend weeks setting things up.

You describe what you need in plain language and Bolter creates and runs agents that can carry out the work end to end. They retain context, remember how you work and can also create real, shareable apps such as trackers and dashboards.

Bolter is funded and currently at the validation-sprint stage, working with a small group of high-impact operators. The product already exists. We are now looking for a founding designer to lead a significant redesign and establish the design foundations for what comes next.

About the role

As Bolter's AI Researcher, your job is to make agents that do real work trustworthy, capable, and useful - and to figure out how before we build it at scale.

This is applied research with direct product impact. You design and run experiments, evaluate what works and what doesn't, and turn findings into decisions the engineering team ships. You'll work directly with the GM and the product engineer in a lean team, with specialised AI agents supporting implementation.

The research problem goes beyond improving a model. It is working out how an agent that retains context, carries out multi-step work and creates software itself can be relied on to do it correctly.

What you’ll do

• Design and run experiments to test how Bolter's agents behave - reliability, context retention, multi-step task completion, and where they fail.

• Build and own the evaluation layer. Design evals that measure whether agents actually do the work, not just whether they sound plausible.

• Research the frontier. Keep Bolter current on the state of the art in LLM agents, tool use, and reliability - and translate that into what we should build.

• Turn findings into decisions. You produce clear, actionable recommendations the engineering team can ship, not just papers.

• Prototype research into product. Take promising ideas from experiment to working prototype, and hand off what proves useful.

• Shape the research roadmap as Bolter grows.

Why you're made for this

• A track record of applied AI/ML research - ideally in LLM application design, agentic systems, evals, or production AI reliability.

• Strong experimental design and analysis. You know how to test a hypothesis rigorously and read the result honestly.

• Strong engineering fundamentals - you can prototype your own experiments, not just direct others to run them.

• Deep familiarity with LLMs, tool use, context management, and the failure modes of agentic systems.

• Strong written communication. Research that isn't understood and acted on doesn't help.

• You're rigorous but pragmatic. You know when a finding is strong enough to act on and when it needs more evidence.

• You're comfortable with ambiguity. Many of the problems we're solving don't have textbook answers.

• You can leverage AI agents as a force multiplier - we run lean, with a small human core augmented by a fleet of specialised agents.

• You care about craft, but you ship.

Bonus points

• Experience with LLM evals, hallucination mitigation, or production AI reliability at scale.

• Experience building or evaluating agentic systems, tool use, or autonomous workflows.

• A public track record - papers, open source, blog posts, side projects. We love researchers who ship outside work too.

• Experience in product-led research - where the output is a shipped feature, not just a finding.