Remote Research Engineer: AI Agent Evaluation & Experiments

Gauntlet; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote-first with in-person retreats

Premium health coverage (medical, dent

Unlimited vacation

Parental leave 12 weeks

Job summary

Gauntlet builds the financial systems of the future, operating across the onchain finance stack to offer vault products. They serve over $1.7B in client TVL across fintechs, protocols, exchanges, and capital allocators, combining traditional finance and crypto-native expertise.

Gauntlet is seeking a hands-on researcher to build evaluation frameworks for AI agents, design experiments, and translate qualitative feedback into measurable outcomes.

Qualifications

• Hands-on experience building, evaluating, or improving LLM models or agents.
• Strong Python skills and software engineering fundamentals.
• Experience with applied research, ML, or data science, including experiment design.

Responsibilities

• Build evaluation frameworks for AI agents, including datasets, sandbox environments, and metrics.
• Design experiments to compare models, agent harnesses, tools, and execution environments.
• Work with teams to turn qualitative feedback into research questions and measurable outcomes.

Skills

LLM/agent evaluation

Python

Experiment design

Job description

Gauntlet builds the financial systems of the future, operating across the onchain finance stack to offer vault products. They serve over $1.7B in client TVL across fintechs, protocols, exchanges, and capital allocators, combining traditional finance and crypto-native expertise.

Gauntlet is seeking a hands-on researcher to build evaluation frameworks for AI agents, design experiments, and translate qualitative feedback into measurable outcomes.