Principal Platform Engineer – Real-Time Inference

Inworld, Inc.; Mountain View (CA); On-site; USD 280,000 - 350,000; Full time

Job summary

Inworld, Inc. is seeking a Staff or Principal Software Engineer to design and scale the Inference platform. You will own core architecture, define abstractions, and ship production-grade services running at tens of trillions of tokens per month.

You'll work on a platform-first backend stack, mainly in Go, with responsibilities across capacity planning, scheduling GPUs, and end-to-end platform reliability. This is a high-impact on-site role in the SF Bay Area.

Qualifications

• 8+ years building backend or distributed systems in Go, Rust, Java or C++.
• You've designed and shipped a multi-service system end to end, and can explain its trade-offs and what broke in production.
• Deep understanding of distributed systems: consistency, failure modes, queuing, load balancing and capacity modelling.
• Experience building a platform or developer product with external customers: cloud compute, PaaS, serverless, or an API platform.
• Clear technical writing. You can turn an ambiguous problem into a design doc that others build from.

Responsibilities

• Design and build the platform's core services: control plane, model and deployment lifecycle APIs, tenant isolation, metering and quotas.
• Own how GPU capacity is allocated and scheduled across shared and reserved workloads, with clear latency, cost and reliability trade-offs.
• Build the path that takes a customer's model from weights to production serving, and keeps it healthy as it changes.
• Write production code, mostly in Go, every week. You ship services; you don't just configure them.
• Define the APIs and abstractions that customers and internal teams build on. Make the right path the easy path.
• Lead design reviews and write the technical direction for the platform. Raise the bar for system design across engineering.
• Run what you build: set SLOs, take part in incidents, and turn postmortems into design changes.

Skills

Backend systems

Go Rust Java C++

Tools

Kubernetes

Terraform

GitOps

Job description

Inworld, Inc. is seeking a Staff or Principal Software Engineer to design and scale the Inference platform. You will own core architecture, define abstractions, and ship production-grade services running at tens of trillions of tokens per month.

You'll work on a platform-first backend stack, mainly in Go, with responsibilities across capacity planning, scheduling GPUs, and end-to-end platform reliability. This is a high-impact on-site role in the SF Bay Area.