AI Prompt & Agent Developer

Fluency Digital, Inc.

San Francisco (CA)

On-site

USD 90,000 - 120,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Fluency Digital, Inc. in San Francisco is seeking a skilled professional to work on their enterprise AI platform, which automates voice sales conversations for healthcare organizations. The candidate will debug clinical-recruiting agent inaccuracies and improve system prompts to ensure high call quality.

The ideal applicant has 2+ years of experience in LLM-powered applications, particularly in prompt engineering, proficient in Python and TypeScript, and a solid understanding of healthcare compliance constraints.

Qualifications

  • 2+ years building or testing LLM-powered applications.
  • Direct prompt-engineering experience.
  • Demonstrated ability to evaluate conversational AI quality.

Responsibilities

  • Debugging mispronunciations in voice sales conversations.
  • Rewriting system prompts for better call quality.
  • Listening to recordings and tracing failure trees.

Skills

Prompt engineering
Proficiency in Python
Proficiency in TypeScript
Evaluating conversational AI quality
Familiarity with healthcare compliance

Job description

Enterprise AI platform automating voice sales conversations for healthcare organizations

You'll spend mornings debugging why a clinical-recruiting agent mispronounced "anesthesiology," then afternoons rewriting system prompts until phone calls pass for human. It's QA as forensic work: listening to recordings, tracing failure trees through Python pipelines, and stress-testing voice agents against edge cases no one predicted. The goal isn't coverage metrics—it's call quality that keeps hospitals from hanging up.

What we're looking for:
  • 2+ years building or testing LLM-powered applications, with direct prompt-engineering experience
  • Proficiency in Python and TypeScript for writing test harnesses and debugging agent logic
  • Demonstrated ability to evaluate conversational AI quality beyond automated metrics—listening, scoring, iterating
  • Familiarity with healthcare compliance constraints or regulated-industry QA standards
  • On-site in San Francisco, working alongside voice engineers and sales teams in tight feedback loops
  • Must be based in the United States.
Tech stack:

Python, TypeScript

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Voice AI Prompt & QA Engineer — On-Site SF
Voice AI Prompt & QA Engineer — On-Site SF

Fluency Digital, Inc. • San Francisco (CA)

On-site
USD 90,000 - 120,000
AI Prompt & Agent Developer
AI Prompt & Agent Developer

OpenCall.ai (YC W24) • New York (NY)

On-site
USD 90,000 - 130,000
AI Solutions Engineer, Customer Agents
AI Solutions Engineer, Customer Agents

Bot Jobs • California

Remote
USD 110,000 - 190,000
Senior Applied AI Engineer - Life Sciences & Healthcare
Senior Applied AI Engineer - Life Sciences & Healthcare

Vi • Austin (TX)

On-site
USD 120,000 - 150,000
AI Prompt Engineer / Agentic AI Engineer
AI Prompt Engineer / Agentic AI Engineer

SmartRecruiters, Inc. • United States

Remote
USD 120,000 - 170,000
Prompt Engineer – Conversational Designer
Prompt Engineer – Conversational Designer

Sensi.AI • Austin (TX)

On-site
USD 100,000 - 170,000
AI Solutions Engineer, Customer Agents (Fully Remote)
AI Solutions Engineer, Customer Agents (Fully Remote)

Attuned Intelligence • United States

Remote
USD 120,000 - 180,000
Application Engineer Senior (7+ Years)
Application Engineer Senior (7+ Years)

Digipulse Technologies, Inc • United States

Remote
USD 120,000 - 170,000
Prompt AI Engineer
Prompt AI Engineer

HyperBlu Labs • San Francisco (CA)

On-site
USD 120,000 - 210,000
Voice AI platform experience
AI evaluation/benchmarking experience
Startup experienece
QA Engineer, Voice AI Agents
QA Engineer, Voice AI Agents

Bot Jobs • Myrtle Point (OR)

Remote
USD 180,000 - 200,000
Salary & Equity
Generous PTO
Health, Vision & Dental
+4