Principal Backend Architect – Real-time AI Inference

Inworld AI

Mountain View (CA)

On-site

USD 280,000 - 350,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Inworld AI, a research lab and inference provider, is hiring a Staff or Principal Software Engineer to design the platform that underpins realtime AI workloads. You’ll shape core architecture, own production-grade code in Go, and define the abstractions that every customer workload runs on as the platform scales to trillions of tokens per month.

You’ll partner with research, product and leadership to guide the platform’s evolution, handle capacity, latency, and reliability, and ensure a

Qualifications

  • 8+ years building backend or distributed systems.
  • Shipped multi-service systems end to end.
  • Ability to write design docs from ambiguous problems.

Responsibilities

  • Design and build the platform's core services.
  • Manage GPU capacity and scheduling for workloads.
  • Write production Go code weekly.
  • Define APIs and abstractions for customers and teams.
  • Lead design reviews and set technical direction.
  • Own SLOs and participate in incidents.

Skills

Backend development
Distributed systems
Go
Rust
Java
C++
System design
Technical writing

Tools

Kubernetes
Terraform
GitOps
ArgoCD

Job description

Inworld AI, a research lab and inference provider, is hiring a Staff or Principal Software Engineer to design the platform that underpins realtime AI workloads. You’ll shape core architecture, own production-grade code in Go, and define the abstractions that every customer workload runs on as the platform scales to trillions of tokens per month.

You’ll partner with research, product and leadership to guide the platform’s evolution, handle capacity, latency, and reliability, and ensure a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Platform Engineer - Real-Time AI Inference (Go)
Principal Platform Engineer - Real-Time AI Inference (Go)

BITKRAFT Ventures • Mountain View (CA)

On-site
USD 280,000 - 350,000
Principal Platform Engineer – Real-Time Inference
Principal Platform Engineer – Real-Time Inference

Inworld, Inc. • Mountain View (CA)

On-site
USD 280,000 - 350,000
Senior Staff ML Engineer — Real-Time Inference at Scale
Senior Staff ML Engineer — Real-Time Inference at Scale

Inworld AI • United States

Remote
USD 188,000 - 269,000
Equity
Benefits
Senior Backend Engineer - AI Inference & Low-Latency
Senior Backend Engineer - AI Inference & Low-Latency

Fdetimes • San Francisco (CA)

On-site
USD 200,000 - 290,000
Startup equity
Health insurance
Staff / Principal Software Engineer, Inference Platform
Staff / Principal Software Engineer, Inference Platform

Inworld, Inc. • Mountain View (CA)

On-site
USD 280,000 - 350,000
Senior Backend Engineer, AI Inference Platform
Senior Backend Engineer, AI Inference Platform

Together AI • San Francisco (CA)

On-site
USD 160,000 - 250,000
Competitive compensation
Startup equity
Health insurance
Staff/Principal Platform Engineer — AI Cloud Infra Lead
Staff/Principal Platform Engineer — AI Cloud Infra Lead

Inworld AI • Mountain View (CA)

On-site
USD 150,000 - 210,000
Senior AI Research Scientist
Senior AI Research Scientist

Inworld AI • United States

Remote
USD 140,000 - 210,000
Principal Research Scientist, Models — Real-Time AI
Principal Research Scientist, Models — Real-Time AI

BITKRAFT Ventures • Mountain View (CA)

On-site
USD 270,000 - 500,000
Relocation assistance
Bonus
Equity
+1
Senior ML Engineer – Real-Time AI at Scale (Germany)
Senior ML Engineer – Real-Time AI at Scale (Germany)

Inworld AI • United States

Remote
USD 180,000 - 240,000