Founding AI Infra Engineer — Multi-Node Inference & Scale

Piris Labs; San Francisco (CA); On-site; USD 100,000 - 200,000; Full time

Benefits offered by this job

Equity

401(k)

Health insurance

Direct impact on product decisions

Job summary

Piris Labs is building the next generation of AI inference infrastructure. We are seeking a Founding AI Infrastructure Engineer to architect and build our inference platform from first principles.

This role spans the entire stack—from control plane orchestration to distributed serving systems, networking, scheduling, observability, and performance optimization. As an early engineer, you will have enormous influence over our architecture, engineering culture, hiring strategy, and product

Qualifications

• Strong foundations in distributed systems, networking, OS, databases, concurrency, and design.
• Proven ability to build systems from scratch and own high-impact problems.
• Proficiency in Go, Rust, C++, or Python.
• Experience with Kubernetes, Linux, containers, service meshes, cloud infra, and automation.

Responsibilities

• Architect and build inference platform from ground up across control plane to distributed serving.
• Work on multi-node model serving, intelligent global request routing, scheduling, observability, and performance optimization.
• Own the engineering foundation and contribute to hiring strategy and product direction.

Skills

Distributed systems

Networking

Operating systems

Databases

Concurrency

Systems design

Go

Rust

C++

Python

Kubernetes

Linux

Containers

Service meshes

Cloud infrastructure

Infrastructure automation

Tools

Kubernetes

Envoy

eBPF

OpenTelemetry

NCCL

RDMA

InfiniBand

TensorRT-LLM

Job description

Piris Labs is building the next generation of AI inference infrastructure. We are seeking a Founding AI Infrastructure Engineer to architect and build our inference platform from first principles.

This role spans the entire stack—from control plane orchestration to distributed serving systems, networking, scheduling, observability, and performance optimization. As an early engineer, you will have enormous influence over our architecture, engineering culture, hiring strategy, and product