Staff Backend Engineer, Ambient AI

Athelas

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Commure is building an AI healthcare platform and is seeking a Staff Backend Engineer to design and operate backend systems powering ambient AI, inference orchestration, and data workflows. You will work across ingestion, processing, and cloud infrastructure, ensuring reliability and performance in production.

You will own latency, scalability, and observability, collaborate with product and AI teams, and mentor teammates while shaping backend architecture for a rapidly growing healthcare tech

Qualifications

  • 8+ years of backend or infrastructure engineering experience.
  • Experience designing, building, and operating production distributed systems.
  • Strong proficiency in at least one modern backend programming language.
  • Experience with asynchronous processing, message queues, event-driven systems, or durable workflow execution.
  • Strong understanding of distributed-systems concepts like idempotency, retries, and backpressure.
  • Experience operating services in a cloud environment with deployment, monitoring, and incident response.
  • Experience designing APIs and data models for complex product workflows.
  • Track record of improving system reliability, observability, scalability, or operational efficiency.
  • Strong debugging across application, infrastructure, data, and external dependency boundaries.

Responsibilities

  • Design, build, and operate backend systems powering Ambient AI products across mobile and web.
  • Evolve inference workflows coordinating transcription, diarization, language models, and extraction.
  • Develop orchestration for long-running workflows with scheduling, retries, and dead-letter handling.
  • Improve reliability and scalability of services under variable, compute-intensive workloads.
  • Define and maintain service-level objectives for critical workflows, including availability and latency.
  • Build observability through structured logging, metrics, tracing, dashboards, alerts, and tooling.
  • Lead incident response and post-incident analysis for important production failures.
  • Mentor engineers and promote best practices for distributed systems and backend architecture.

Skills

Backend engineering
Distributed systems
Cloud infrastructure
APIs design
Observability
Asynchronous processing
Debugging
Data modeling
Ownership mindset

Job description

At Commure, we're building the AI Operating System for healthcare, the foundation that defines how care is delivered, documented, and financed. Our platform spans the full care journey: Ambient AI and Dictation eliminating documentation burden at the point of care, intelligent Agents automating patient and revenue workflows, and autonomous RCM processing billions in claims, all on a single AI-native platform integrated with 60+ EHRs.

Healthcare carries a $1 trillion administrative burden and we're at the center of transforming it. Today, 500,000+ clinicians across 500+ healthcare organizations nationwide trust Commure to handle $25B+ in annual claims and support over 200 million patient interactions. Our latest $70M raise at a $7B valuation reflects the confidence the market has placed in this mission. We've also been named to the Fortune Future 50 list and the 2026 AI Breakthrough Awards for “Overall NLP Company of the Year.”

Our team works directly alongside clinicians, not through layers of process, which means the gap between what you build and its impact on patient care is immediate. We move fast, deploy daily, and take full ownership from early thinking to production. If you're energized by hard problems, high stakes, and a team that holds itself to a high bar, you'll find your people here.

The future of healthcare is being built right now.

About the Role

We’re building a next-generation ambient AI product suite for healthcare, helping clinicians focus on patient care by automatically capturing, understanding, and structuring clinical conversations.

Behind that experience is a distributed system responsible for ingesting long-form audio, processing real-time and asynchronous streams, orchestrating multiple AI models, and reliably producing clinical outputs. These workflows must remain observable and recoverable across network interruptions, partial failures, model timeouts, and rapidly changing inference infrastructure.

We’re hiring a Staff Backend Engineer to help build and operate this foundation. You’ll work across audio ingestion, media processing, inference orchestration, distributed workflows, storage, observability, and cloud infrastructure.

This role is ideal for an engineer who enjoys making complex systems dependable. You think carefully about failure modes, idempotency, backpressure, data integrity, latency, and operational simplicity. You also understand that infrastructure exists to serve the product: the systems you build must ultimately create a fast, reliable, and trustworthy experience for clinicians.

What You’ll Do
  • Design, build, and operate backend systems that power our Ambient AI products across mobile and web.

  • Build and evolve inference workflows that coordinate transcription, diarization, language models, clinical extraction, summarization, and other AI capabilities.

  • Develop orchestration systems for long-running, multi-stage workflows, including:

    • Scheduling, queueing, and workload prioritization

    • Retries, timeouts, fallbacks, and dead-letter handling

    • Idempotency, replay, and safe workflow recovery

    • Model routing, versioning, and configuration

    • Progress tracking and user-visible workflow state

    • Graceful degradation when dependencies are unavailable

  • Improve the reliability and scalability of services operating under variable, compute-intensive workloads.

  • Define and maintain service-level objectives for critical workflows, including availability, processing latency, completion rates, and data durability.

  • Build strong observability across services and pipelines through structured logging, metrics, distributed tracing, dashboards, alerting, and diagnostic tooling.

  • Lead incident response and post-incident analysis for important production failures, turning operational lessons into lasting improvements.

  • Identify systemic failure patterns and eliminate them through better abstractions, automation, testing, and architecture.

  • Improve cloud infrastructure, deployment systems, capacity planning, and operational tooling as the platform scales.

  • Design APIs and data models that allow mobile, web, and internal systems to interact with long-running workflows safely and predictably.

  • Build tools that make inference pipelines easier to inspect, test, replay, evaluate, and debug.

  • Balance reliability, latency, quality, and infrastructure cost across AI and media-processing workloads.

  • Partner closely with mobile, product, AI, security, and clinical teams to turn new capabilities into production-ready workflows.

  • Mentor other engineers and help establish strong practices for distributed systems, observability, operational readiness, and backend architecture.

What You Have
  • 8+ years of professional backend or infrastructure engineering experience.

  • Experience designing, building, and operating production distributed systems.

  • Strong proficiency in at least one modern backend programming language.

  • Experience with asynchronous processing, message queues, event-driven systems, or durable workflow execution.

  • A strong understanding of distributed-systems concepts such as idempotency, consistency, concurrency, backpressure, retries, failure isolation, and eventual completion.

  • Experience operating services in a cloud environment, including deployment, monitoring, scaling, and incident response.

  • Experience designing APIs, service boundaries, and data models for complex product workflows.

  • A track record of improving system reliability, observability, scalability, or operational efficiency.

  • Strong debugging skills across application, infrastructure, data, and external dependency boundaries.

  • An ability to reason about both real-time and long-running workloads with different latency and durability requirements.

  • Comfort working across backend, infrastructure, product, and AI systems rather than within a narrowly defined layer.

  • An ownership mindset and bias for action. You identify important risks, create clarity, and drive ambiguous infrastructure work through completion.

Nice to Haves
  • Experience building speech-to-text, diarization, transcription, or other audio-based machine-learning workflows.

  • Experience orchestrating large language models or multi-model inference pipelines in production.

  • Familiarity with workflow orchestration systems such as Temporal or similar durable execution platforms.

  • Experience with event-streaming and messaging technologies such as Kafka, Pub/Sub, SQS, or similar systems.

  • Experience with model routing, inference gateways, rate limiting, batching, caching, or GPU-backed workloads.

  • Experience building internal tooling for workflow inspection, replay, evaluation, or model debugging.

  • Experience defining SLOs, managing error budgets, designing alerts, and leading production incident response.

  • Familiarity with distributed tracing and observability platforms such as Grafana, OpenTelemetry, Sentry, or similar tools.

  • Experience with containers, Kubernetes, infrastructure as code, and cloud-native deployment systems.

  • Experience optimizing systems for throughput, tail latency, infrastructure cost, and workload isolation.

  • Experience with offline clients, background synchronization, or systems that reconcile delayed and duplicated events.

  • Exposure to healthcare, HIPAA, SOC 2, encryption, privacy, security, or other regulated environments.

  • Experience supporting AI-native, real-time, or agentic product experiences.

Why Join
  • Build the backend foundation for an AI healthcare product used in real clinical workflows.

  • Solve challenging systems problems involving distributed orchestration, and production AI.

  • Make reliability improvements that clinicians experience directly through faster, safer, and more dependable workflows.

  • Shape how inference systems are orchestrated, observed, recovered, and scaled in production.

  • Work closely with product and AI teams while maintaining deep ownership of backend architecture and infrastructure.

  • Help define the operational and engineering standards for a rapidly growing platform.

  • Join at a stage where core systems, technical strategy, and engineering culture are still highly shapeable.

  • Grow into broader backend, infrastructure, or technical leadership as the team and product expand.

Please be aware that all official communication from us will come exclusively from email addresses ending in @commure.com. Any emails from other domains are not affiliated with our organization.


Employees will act in accordance with the organization’s information security policies, to include but not limited to protecting assets from unauthorized access, disclosure, modification, destruction or interference nor execute particular security processes or activities. Employees will report to the information security office any confirmed or potential events or other risks to the organization. Employees will be required to attest to these requirements upon hire and on an annual basis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Commure • San Francisco (CA)

On-site
USD 190,000 - 250,000
Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Athelas • Mountain View (CA)

On-site
USD 210,000 - 275,000
Staff Backend Engineer, Ambient AI
Staff Backend Engineer, Ambient AI

Commure • Mountain View (CA)

On-site
USD 210,000 - 275,000
Senior iOS Engineer, Ambient AI
Senior iOS Engineer, Ambient AI

Athelas • San Francisco (CA)

On-site
USD 120,000 - 180,000
Senior Fullstack Engineer, Ambient AI
Senior Fullstack Engineer, Ambient AI

Athelas • San Francisco (CA)

On-site
USD 140,000 - 200,000
Senior Backend Engineer, Ambient AI
Senior Backend Engineer, Ambient AI

COMMURE Incorporated • California (MO)

On-site
USD 90,000 - 130,000
Fullstack Engineer, Ambient AI
Fullstack Engineer, Ambient AI

COMMURE Incorporated • Mountain View (CA)

On-site
USD 150,000 - 230,000
Senior Fullstack Engineer, Ambient AI
Senior Fullstack Engineer, Ambient AI

Commure • San Francisco (CA)

On-site
USD 180,000 - 230,000
Staff Backend Engineer
Staff Backend Engineer

Commure • San Francisco (CA)

On-site
USD 190,000 - 240,000
Software Engineer, Early Career 2027
Software Engineer, Early Career 2027

Commure • Mountain View (CA)

On-site
USD 120,000 - 150,000