Staff/Principal Engineer

HRB; Vancouver; On-site; CAD 150,000 - 200,000; Full time

Job summary

Inworld is seeking a Staff/Principal backend engineer with 8+ years of experience to design and operate cloud-based services at scale. This IC role emphasizes autonomy, end-to-end shipping of platform products, and adaptability across tools and languages.

The candidate should have startup or growth-stage background, AI product experience, and a track record of building high-scale systems across cloud providers.

Qualifications

• 8+ years of backend software engineering experience.
• Startup or growth-stage experience preferred.
• Shipped zero-to-one platform or product end-to-end.
• Strong cloud infrastructure experience across GCP, AWS, or Azure.
• CS/ physics/ math/ engineering or similar STEM degree.

Responsibilities

• Own core backend systems for an intelligent routing layer across 200+ LLMs with multi-provider failover.
• Build and scale API-based model services across TTS, STT, LLM, and Knowledge/RAG.
• Power infrastructure for consumer-facing AI apps serving hundreds of millions of users.
• Design real-time, low-latency systems for speech-to-speech and live API products.
• Collaborate with PMs, engineers, and ML teams to ship fast and meet needs.
• Drive system improvements and set architectural standards and dependencies.
• Tackle ambitious new product and system-wide infra projects.

Skills

Backend engineering

Distributed systems

Go

Python

C++

Rust

PostgreSQL

MySQL

Redis

Kubernetes

gRPC

OpenTelemetry

Education

CS degree

Tools

GCP

AWS

Azure

Kubernetes

Flink

Beam

gRPC

OpenTelemetry

Job description

About the Role

Inworld is looking for a Staff/Principal-level backend engineer with 8+ years of experience building and operating cloud-based services at scale.
The ideal candidate is a strong IC with high technical autonomy, a track record of shipping zero-to-one platform products end-to-end, and the ability to adapt across tools and programming languages.
Startup or growth-stage experience is strongly preferred. AI product experience, founder experience, or experience at high-caliber AI/infrastructure companies such as Databricks is a plus.

What You'll Do

• Own core backend systems foran intelligent routing layer across 200+ LLMs with:
  • Multi-provider failover
  • Cost/latency-based routing
  • Real-time observability at massive scale
• Build and scale API-based model services across TTS, STT, LLM, and Knowledge/RAG.
• Build infrastructure powering consumer-facing AI applications serving hundreds of millions of end users.
• Design and implement real-time, low-latency systems for speech-to-speech and Realtime API products.
• Collaborate closely with PMs, engineers, and ML teams to identify product needs and ship quickly.
• Drive system improvements and influence technical standards, dependencies, and architectural decisions.
• Work on ambitious new products and system-wide infrastructure projects.

Key Context

• Pure IC role- no management responsibilities, but significant ownership expected.
• Flat team structure reporting to theVP of Engineering.
• Immediate engineering team of approximately 7-8 people.
• AI tools and agents are embraced throughout the development and interview process.
• Startup experience is strongly preferred; candidates coming exclusively from large tech companies are not a fit.
• Adaptability across languages and technologies is valued more than deep specialization in a single language.

Tech Stack

Go, Python, C++, Rust, PostgreSQL, MySQL, Redis, Memcached, Apache Flink, Apache Beam, ClickHouse, OpenTelemetry, GCP, AWS, Azure, Kubernetes, gRPC.

Candidate Requirements

Dealbreakers

• Built and operated cloud-based services at high scale - hundreds+ QPS.
• Hands-on experience with caching technologies such as Redis/Memcached, pub/sub or queues, and data pipelines such as Flink or Beam.

Baseline

• 8+ years of backend software engineering experience.
• At least one startup or growth-stage company in their background; not exclusively big tech.
• Has shipped zero-to-one platform or product builds end-to-end.
• Technical degree in CS, physics, math, engineering, or a similar STEM field.
• Strong cloud infrastructure experience across GCP, AWS, or Azure.
• Experience operating relational databases such as PostgreSQL or MySQL at scale.

Nice to Have

• Experience building AI products or real-time consumer-facing systems.
• Experience building API gateways, routing/proxy layers, or multi-provider orchestration systems.
• AI product, founder, or high-caliber AI/infrastructure startup experience.