Clinical AI Agent Designer & Evaluator

present of AI

San Francisco, New York (CA, NY)

On-site

USD 120,000 - 180,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary

Job summary

Bunkerhill Health seeks to advance AI-powered clinical agents through rigorous design, testing, and evaluation. You will work on high-volume, real-world medical tasks, ensuring agents are correct, affordable, and fast while integrating with health record systems.

The role emphasizes experimentation, writing code, and judging results from noisy data, with a focus on tools, memory, and prompt design. Join a team shaping practical AI in healthcare environments.

Qualifications

  • Experience designing and evaluating agentic systems for clinical workflows.
  • Solid grounding in agent concepts like tool calling, memory, and prompt design.
  • Familiarity with health data standards and working in healthcare environments.

Responsibilities

  • Design and test AI agents for high-volume clinical tasks.
  • Measure agent performance for correctness, cost, and speed in noisy data.
  • Collaborate with engineering and health IT teams to deploy end-to-end solutions.

Skills

Agent design
Evaluation
Coding in teams
Prototype to production
Experimentation

Job description

Bunkerhill Health seeks to advance AI-powered clinical agents through rigorous design, testing, and evaluation. You will work on high-volume, real-world medical tasks, ensuring agents are correct, affordable, and fast while integrating with health record systems.

The role emphasizes experimentation, writing code, and judging results from noisy data, with a focus on tools, memory, and prompt design. Join a team shaping practical AI in healthcare environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Agent Researcher
Agent Researcher

present of AI • San Francisco (CA), New York (NY)

On-site
USD 120,000 - 180,000
Competitive salary
AI Agent Researcher
AI Agent Researcher

Bunkerhill Health • San Francisco (CA), New York (NY)

On-site
USD 150,000 - 210,000
Agent Researcher
Agent Researcher

Bunkerhill Health • San Francisco (CA), New York (NY)

On-site
USD 150,000 - 210,000
Applied AI Agent Engineer for Healthcare Automation
Applied AI Agent Engineer for Healthcare Automation

Bask Health • United States

Remote
USD 120,000 - 160,000
AI Agent Engineer for Health Tech SaaS
AI Agent Engineer for Health Tech SaaS

Hiringhood • United States

Remote
USD 120,000 - 170,000
Remote Clinical AI Evaluator & Task Designer
Remote Clinical AI Evaluator & Task Designer

Planet Pharma • San Francisco (CA)

Remote
USD 120,000 - 180,000
AI Evaluation Engineer — Build Safe, Deploy-Ready Agents
AI Evaluation Engineer — Build Safe, Deploy-Ready Agents

nuna • United States

On-site
USD 140,000 - 180,000
Production AI Agent Engineer for Automated Workflows
Production AI Agent Engineer for Automated Workflows

Bask Health • New York (NY)

On-site
USD 120,000 - 180,000
Senior AI Product Manager — Healthcare Agents
Senior AI Product Manager — Healthcare Agents

Assort Health • San Francisco (CA)

On-site
USD 150,000 - 190,000
Competitive Compensation
Lifelong Learning
Office Setup Stipend
+6
Clinical AI Engineer - Build Safer, Smarter Medical AI
Clinical AI Engineer - Build Safer, Smarter Medical AI

Counsel Health, Inc. • United States

Remote
USD 180,000 - 300,000