Member of Technical Staff, Applied AI – Speech

Salient

United States

Remote

USD 170,000 - 260,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision coverage
Generous 401(k)
Catered lunches

Job summary

Salient is hiring a Member of Technical Staff to develop speech-to-speech and real-time voice models powering our production voice agents. You will tackle full-duplex interaction, streaming inference, neural codecs, and the gap between academic benchmarks and live service performance.

This high-ownership role sits on a small Applied AI team, focusing on end-to-end speech stack work that directly affects borrower conversations. The role is fully remote, with collaboration to the SF headquarters.

Qualifications

  • 5+ years in speech, audio, or related ML
  • Proven work on real-time speech systems beyond offline benchmarks
  • Public proof via papers, repos, or models we can inspect
  • Strong engineering fundamentals for production systems
  • Ability to diagnose real-world model failures and improve systems
  • High ownership and execution speed in ambiguous tech areas

Responsibilities

  • Design, train, and ship speech-to-speech and real-time voice models for live calls
  • Build production speech stack including codecs, streaming, and ASR/TTS pathways
  • Develop evals and monitoring reflecting real borrower conversations
  • Diagnose telephony noise, barge-in, accents, and channel variation to drive improvements
  • Collaborate with Applied AI and Voice AI teams to raise end-to-end agent quality
  • Own major technical areas from problem definition to production deployment

Skills

Speech ML
Real-time systems
Production-grade
Latency optimization
Ownership
Cross-functional collaboration

Tools

GitHub
Hugging Face

Job description

About Us

Salient builds AI agents for regulated financial services. Our agents automate loan servicing, compliance, collections, recovery, insurance claims, and disputes for banks, captives, and specialty lenders.

We are:

  • Backed by a16z and Y Combinator, with $75M raised in Series A funding

  • Cash flow positive and profitable, with mid eight figure ARR achieved in under two years

  • Already serving more than 20% of the auto lending industry

  • Processing millions of real customer calls and transactions every day

  • Fully deployed in production with major financial institutions

  • Actively expanding into new financial services segments

  • Building together in person in San Francisco

We are deeply integrated with our customers, own the full technology stack, and move quickly to bring modern AI into regulated industries where precision, reliability, and performance matter.

About Us

Salient builds AI agents for regulated financial services. Our agents automate loan servicing, compliance, collections, recovery, insurance claims, and disputes for banks, captives, and specialty lenders.

We are:

  • Backed by a16z and Y Combinator, with $75M raised in Series A funding

  • Cash flow positive and profitable, with mid eight figure ARR achieved in under two years

  • Already serving more than 20% of the auto lending industry

  • Processing millions of real customer calls and transactions every day

  • Fully deployed in production with major financial institutions

  • Actively expanding into new financial services segments

  • Headquartered in San Francisco, and hiring this role remotely

We are deeply integrated with our customers, own the full technology stack, and move quickly to bring modern AI into regulated industries where precision, reliability, and performance matter.

Our flagship voice product, Taylor, handles inbound and outbound collections and servicing conversations across voice, SMS, email, and chat, with real-time compliance guardrails for frameworks such as FDCPA, TCPA, and CFPB.

About the Role

We're looking for a Member of Technical Staff to help build the speech-to-speech and real-time voice models behind Salient's production voice agents.

You'll work on the hardest parts of conversational speech: full-duplex interaction, streaming inference, neural codecs, and the gap between academic benchmarks and what actually holds up on a live collections or servicing call. Many of these problems look solved in papers. They remain deeply unsolved in production, at the latency, reliability, and compliance bar our lenders require.

This is a high-ownership role on a small, elite Applied AI team. You'll own core parts of the speech stack end to end, and everything you do will have direct impact on live borrower conversations.

This role is fully remote. You do not need to relocate to San Francisco. You will collaborate closely with the Applied AI team at our SF headquarters.

What You'll Do
  • Design, train, and ship speech-to-speech and real-time voice models that improve conversational quality on live calls: latency, turn-taking, naturalness, robustness, and interruption handling.

  • Build and improve the production speech stack around those models: neural codecs, streaming inference, ASR/TTS or speech-to-speech pathways, turn detection, and speech enhancement.

  • Develop evals, harnesses, and monitoring that reflect real borrower conversations, not just clean benchmarks.

  • Diagnose messy real-world failures (telephony noise, barge-in, accent and channel variation, overlapping speech) and turn them into model, data, or systems improvements that ship.

  • Work across models, data, infrastructure, and product with the Applied AI and Voice AI teams to raise end-to-end agent quality.

  • Own major technical areas with significant autonomy, from problem definition to production deployment.

What We're Looking For
  • 5+ years of experience in speech, audio, or related machine learning, or equivalent demonstrated depth through shipped systems and public work.

  • Proven work on speech-to-speech, full-duplex, or other real-time conversational speech systems, not only offline ASR or TTS in isolation.

  • Public proof of work: papers, GitHub repositories, Hugging Face models or datasets, or other artifacts we can inspect.

  • Strong engineering fundamentals and the ability to build reliable production systems, including streaming or low-latency inference.

  • Ability to diagnose messy real-world model failures and turn them into practical improvements.

  • High ownership, strong execution speed, and comfort operating in ambiguous technical areas.

Nice to have
  • Deep experience with neural audio codecs, vocoders, or discrete speech representations used in modern speech-to-speech stacks.

  • Experience with turn detection, barge-in, speech enhancement, or multilingual speech in production telephony or contact-center settings.

  • Experience post-training or adapting language models for voice agents, and building evals that predict production quality.

  • Familiarity with the constraints of regulated or high-stakes conversations, where errors have real consequences.

We care about evidence of shipped speech systems and technical depth more than a particular job title. If your public work clearly shows you have built this, we want to talk to you.

Why Join
  • Work on the full stack of production voice AI, with a mandate to push speech-to-speech and real-time conversation quality.

  • Own and lead core parts of the speech stack on a small, high-caliber Applied AI team.

  • Ship improvements that affect millions of live conversations.

  • Tackle real-world speech problems that are still unsolved outside of benchmarks.

At Salient, we're building at the edge of AI: fast, focused, and with real ownership. Sprints and major launches move quickly, and we look for people who are energized by that pace.

Compensation will be competitive for your market and will include equity. Benefits will be confirmed for the country you are hired in.

The team typically works around 60 hours per week, beginning at 8:00 AM, with four days spent collaborating in person at our San Francisco office.

  • medical, dental, and vision coverage
  • generous 401(k)
  • catered lunches
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Applied AI – Speech
Member of Technical Staff, Applied AI – Speech

Salient • San Francisco (CA)

Remote
USD 180,000 - 240,000
Medical coverage
Dental coverage
Vision coverage
+4
Applied AI Engineer
Applied AI Engineer

Salient • San Francisco (CA)

On-site
USD 120,000 - 160,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
Member of Technical Staff, Applied AI – Speech (Fully Remote)
Member of Technical Staff, Applied AI – Speech (Fully Remote)

Salient • United States

Remote
USD 140,000 - 190,000
Cloud Infrastructure Engineer
Cloud Infrastructure Engineer

Salient • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
AI Deployment Lead
AI Deployment Lead

Salient • San Francisco (CA)

On-site
USD 140,000 - 180,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
Staff AI Speech Engineer - Real-Time Voice Systems
Staff AI Speech Engineer - Real-Time Voice Systems

Salient • United States

Remote
USD 170,000 - 260,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
Staff AI Engineer — Speech & Voice Production
Staff AI Engineer — Speech & Voice Production

Salient • San Francisco (CA)

On-site
USD 120,000 - 160,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
Founder's Office
Founder's Office

Salient • San Francisco (CA)

On-site
USD 180,000 - 240,000
Medical, dental, and vision coverage
Generous 401(k)
Catered lunches
Senior Member of Technical Staff
Senior Member of Technical Staff

Thomas Talent Network • San Francisco (CA)

On-site
USD 225,000 - 300,000
Staff AI Engineer: Real-Time Speech & Voice Systems
Staff AI Engineer: Real-Time Speech & Voice Systems

Salient • United States

Remote
USD 140,000 - 190,000