Staff Backend Engineer: AI Infra for Scalable Healthcare

Nxt Level

San Francisco (CA)

Hybrid

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Nxt Level is seeking a Staff Backend Engineer, AI Infrastructure in the SF Bay Area. This hands‑on role focuses on reliability, scalability, observability, and orchestration of long‑running AI inference workflows across mobile and web applications.

You will own backend infrastructure supporting audio ingestion, transcription, speaker diarization, LLM processing, clinical data extraction, and summarization. The ideal candidate will have experience building distributed systems at scale and

Qualifications

  • 8+ years of backend or infrastructure experience.
  • Experience designing, building, and operating production distributed systems at scale.
  • Strong understanding of asynchronous processing, message queues, and workflow orchestration.
  • Experience building reliable systems for long‑running, compute‑intensive workloads.
  • Strong knowledge of retries, idempotency, timeouts, dead‑letter queues, and fault tolerance.
  • Experience designing production APIs, backend services, and cloud infrastructure.
  • Deep understanding of observability, monitoring, distributed tracing, and incident response.
  • Demonstrated ability to improve system reliability, scalability, and performance.

Responsibilities

  • Design and operate scalable backend systems supporting AI-powered healthcare applications.
  • Build infrastructure for long‑form audio ingestion, media processing, and real‑time and asynchronous streaming.
  • Own orchestration for multi‑stage AI inference workflows, including transcription, diarization, LLMs, clinical extraction, and summarization.
  • Build reliable scheduling, queueing, retries, timeouts, dead‑letter handling, idempotency, and replay systems.
  • Improve system resilience through graceful degradation and recovery mechanisms.
  • Support mobile and web workflows operating under poor connectivity, unstable networks, and offline conditions.
  • Define and maintain service‑level objectives (SLOs) for critical production workflows.
  • Build observability through structured logging, metrics, distributed tracing, dashboards, and alerting.
  • Lead incident response, root‑cause analysis, and long‑term reliability improvements.
  • Design and improve APIs, data models, cloud infrastructure, and deployment systems.
  • Balance infrastructure cost, latency, reliability, and model quality.
  • Mentor other engineers and establish standards for distributed systems and operational readiness.

Skills

Distributed systems
Observability
Incident response
Cloud infrastructure
Asynchronous processing
Architecture leadership

Job description

Nxt Level is seeking a Staff Backend Engineer, AI Infrastructure in the SF Bay Area. This hands‑on role focuses on reliability, scalability, observability, and orchestration of long‑running AI inference workflows across mobile and web applications.

You will own backend infrastructure supporting audio ingestion, transcription, speaker diarization, LLM processing, clinical data extraction, and summarization. The ideal candidate will have experience building distributed systems at scale and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Backend Engineer
Staff Backend Engineer

Nxt Level • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Staff Backend Engineer, Ambient AI Platform
Staff Backend Engineer, Ambient AI Platform

SportsTechJobs • Mountain View (CA)

On-site
USD 110,000 - 165,000
Remote Staff Backend AI Engineer for Scalable AI Systems
Remote Staff Backend AI Engineer for Scalable AI Systems

ByteHire Limited. • New York (NY)

Remote
USD 150,000 - 250,000
Generous PTO
Health insurance
Life and disability insurance
+2
Staff Backend Engineer — AI Platform for Healthcare
Staff Backend Engineer — AI Platform for Healthcare

Ambience Healthcare • San Francisco (CA)

Hybrid
USD 225,000 - 300,000
Competitive salary and equity compensation
Health, dental, and vision coverage
Quarterly retreats
+2
Staff Software Engineer - AI Healthcare Backend Platform
Staff Software Engineer - AI Healthcare Backend Platform

present of AI • San Francisco (CA)

On-site
USD 210,000 - 320,000
Staff Backend Engineer, Ambient AI for Healthcare
Staff Backend Engineer, Ambient AI for Healthcare

Commure • San Francisco (CA)

On-site
USD 190,000 - 250,000
Staff Backend Engineer, Ambient AI for Healthcare
Staff Backend Engineer, Ambient AI for Healthcare

Athelas, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Backend Engineer - Healthcare AI (Hybrid)
Senior Backend Engineer - Healthcare AI (Hybrid)

Take a Seat Tech • San Francisco (CA)

Hybrid
USD 175,000 - 250,000
Senior AI Infrastructure Engineer for Scalable Healthcare
Senior AI Infrastructure Engineer for Scalable Healthcare

Speedrun Talent Network • Menlo Park (CA)

On-site
USD 180,000 - 240,000
Fullstack Engineer - AI Infra & Enterprise Backend
Fullstack Engineer - AI Infra & Enterprise Backend

Scion Staffing, Inc. • San Francisco (CA)

On-site
USD 160,000 - 180,000
Own products end-to-end with meaning
Work with enterprise customers
Grow with experienced engineers