Founding AI Infra Engineer — Build the Inference Layer

Jack & Jill; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Piris Labs, a San Francisco startup backed by YC, is seeking a Founding AI Infrastructure Engineer to architect a high-performance inference platform from the ground up. You’ll solve distributed systems challenges across multi-node serving, GPU orchestration, and intelligent routing.

This is a rare opportunity to define foundational technology and own the infra stack as one of the first five engineers, shaping engineering culture and product direction.

Qualifications

• Strong fundamentals in distributed systems, networking, OS, and concurrency.
• Proficient in Go, Rust, or C with Python for orchestration.
• Experience with cloud infra, Kubernetes-based platforms, and AI workloads.

Responsibilities

• Architect and build a production-grade distributed inference platform.
• Develop network-aware routing and distributed KV-cache to reduce latency.
• Implement high-performance networking with eBPF, RDMA, and NCCL.

Skills

Distributed systems

Networking

Go

Rust

Python

C

Kubernetes

Concurrency

Operating systems

HPC

Tools

eBPF

RDMA

NCCL

Job description

Piris Labs, a San Francisco startup backed by YC, is seeking a Founding AI Infrastructure Engineer to architect a high-performance inference platform from the ground up. You’ll solve distributed systems challenges across multi-node serving, GPU orchestration, and intelligent routing.

This is a rare opportunity to define foundational technology and own the infra stack as one of the first five engineers, shaping engineering culture and product direction.