Staff Backend Engineer

Nxt Level

San Francisco (CA)

Hybrid

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Nxt Level is seeking a Staff Backend Engineer, AI Infrastructure in the SF Bay Area. This hands‑on role focuses on reliability, scalability, observability, and orchestration of long‑running AI inference workflows across mobile and web applications.

You will own backend infrastructure supporting audio ingestion, transcription, speaker diarization, LLM processing, clinical data extraction, and summarization. The ideal candidate will have experience building distributed systems at scale and

Qualifications

  • 8+ years of backend or infrastructure experience.
  • Experience designing, building, and operating production distributed systems at scale.
  • Strong understanding of asynchronous processing, message queues, and workflow orchestration.
  • Experience building reliable systems for long‑running, compute‑intensive workloads.
  • Strong knowledge of retries, idempotency, timeouts, dead‑letter queues, and fault tolerance.
  • Experience designing production APIs, backend services, and cloud infrastructure.
  • Deep understanding of observability, monitoring, distributed tracing, and incident response.
  • Demonstrated ability to improve system reliability, scalability, and performance.

Responsibilities

  • Design and operate scalable backend systems supporting AI-powered healthcare applications.
  • Build infrastructure for long‑form audio ingestion, media processing, and real‑time and asynchronous streaming.
  • Own orchestration for multi‑stage AI inference workflows, including transcription, diarization, LLMs, clinical extraction, and summarization.
  • Build reliable scheduling, queueing, retries, timeouts, dead‑letter handling, idempotency, and replay systems.
  • Improve system resilience through graceful degradation and recovery mechanisms.
  • Support mobile and web workflows operating under poor connectivity, unstable networks, and offline conditions.
  • Define and maintain service‑level objectives (SLOs) for critical production workflows.
  • Build observability through structured logging, metrics, distributed tracing, dashboards, and alerting.
  • Lead incident response, root‑cause analysis, and long‑term reliability improvements.
  • Design and improve APIs, data models, cloud infrastructure, and deployment systems.
  • Balance infrastructure cost, latency, reliability, and model quality.
  • Mentor other engineers and establish standards for distributed systems and operational readiness.

Skills

Distributed systems
Observability
Incident response
Cloud infrastructure
Asynchronous processing
Architecture leadership

Job description

Location: hybrid in Mountain View, CA or San Francisco Bay Area (3+ days/week on- site)

Employment Type: Full-time

Experience: 8+ years

About Our Client

Our client is building AI-powered healthcare technology that transforms how clinicians capture, process, and document patient interactions.

Their Ambient AI products use speech processing, machine learning, and large language models to turn clinical conversations into structured, actionable information.

The company is looking for an experienced backend infrastructure engineer to build and scale the systems that power these AI workflows across mobile and web applications.

About the Role

Our client is hiring a Staff Backend Engineer, AI Infrastructure to design, build, and operate the distributed systems behind its Ambient AI products.

This is a hands‑on engineering role focused on reliability, scalability, observability, and orchestration of long-running AI inference workflows.

You’ll own critical backend infrastructure supporting audio ingestion, transcription, speaker diarization, LLM processing, clinical data extraction, and summarization.

The ideal candidate has experience building distributed systems at scale, understands how to operate compute-heavy workloads in production, and has a track record of making systems measurably more reliable.

What You’ll Do
  • Design and operate scalable backend systems supporting AI-powered healthcare applications.
  • Build infrastructure for long‑form audio ingestion, media processing, and real‑time and asynchronous streaming.
  • Own orchestration for multi‑stage AI inference workflows, including transcription, diarization, LLMs, clinical extraction, and summarization.
  • Build reliable scheduling, queueing, retries, timeouts, dead‑letter handling, idempotency, and replay systems.
  • Improve system resilience through graceful degradation and recovery mechanisms.
  • Support mobile and web workflows operating under poor connectivity, unstable networks, and offline conditions.
  • Define and maintain service‑level objectives (SLOs) for critical production workflows.
  • Build observability through structured logging, metrics, distributed tracing, dashboards, and alerting.
  • Lead incident response, root‑cause analysis, and long‑term reliability improvements.
  • Design and improve APIs, data models, cloud infrastructure, and deployment systems.
  • Balance infrastructure cost, latency, reliability, and model quality.
  • Mentor other engineers and establish standards for distributed systems and operational readiness.
What We’re Looking For
  • 8+ years of backend or infrastructure engineering experience (7+ for exceptional candidates).
  • Experience designing, building, and operating production distributed systems at scale.
  • Strong understanding of asynchronous processing, message queues, and workflow orchestration.
  • Experience building reliable systems for long‑running, compute‑intensive workloads.
  • Strong knowledge of retries, idempotency, timeouts, dead‑letter queues, and fault tolerance.
  • Experience designing production APIs, backend services, and cloud infrastructure.
  • Deep understanding of observability, monitoring, distributed tracing, and incident response.
  • Demonstrated ability to improve system reliability, scalability, and performance.
  • Ability to make architecture decisions in fast‑moving, ambiguous environments.
  • Strong technical leadership and ability to mentor engineers.
Bonus Experience
  • Current or previous Staff Engineer, Tech Lead, or equivalent technical leadership experience.
  • Experience building audio, speech, media processing, or real‑time streaming infrastructure.
  • Experience orchestrating multi‑stage AI or ML inference pipelines.
  • Experience with mobile backend systems and unreliable network environments.
  • Experience building AI applications used in healthcare or clinical settings.
  • Background combining healthcare technology experience with large‑scale engineering at a major technology company.
  • Familiarity with EHR systems, clinical workflows, or enterprise healthcare infrastructure.
Why This Opportunity
  • Own critical infrastructure behind production AI applications used in healthcare.
  • Solve challenging distributed systems problems involving audio, streaming, and multi‑stage AI inference.
  • Build systems where reliability directly affects clinician workflows.
  • Work across backend infrastructure, AI, mobile, and product engineering.
  • Influence architectural decisions and operational engineering standards.
  • Help scale AI‑powered healthcare applications through better reliability, observability, and infrastructure.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Athelas, Inc. • Mountain View (CA)

On-site
USD 210,000 - 275,000
Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Commure • San Francisco (CA)

On-site
USD 190,000 - 250,000
Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Commure • Mountain View (CA)

On-site
USD 210,000 - 275,000
Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Athelas, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff Software Engineer, Distributed Systems
Staff Software Engineer, Distributed Systems

present of AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff Backend Engineer: AI Infra for Scalable Healthcare
Staff Backend Engineer: AI Infra for Scalable Healthcare

Nxt Level • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Staff Engineer
Staff Engineer

Ranger Technical Resources, Inc. • California

On-site
USD 150,000 - 210,000
Senior Backend Engineer, Ambient AI for Healthcare Transformation
Senior Backend Engineer, Ambient AI for Healthcare Transformation

Commure • California

On-site
USD 90,000 - 130,000
Senior Software Engineer
Senior Software Engineer

Storm3 • San Francisco (CA)

Hybrid
USD 180,000 - 200,000
Staff Software Engineer, Product
Staff Software Engineer, Product

present of AI • San Francisco (CA)

On-site
USD 210,000 - 320,000