Staff Engineer, Scalable AI Inference Platform

Salient Group; San Francisco (CA); Sur place; USD 180 000 - 260 000; Plein temps

Résumé du poste

Salient Group is building the infrastructure behind demanding model-serving workloads in San Francisco. You will own the production inference platform end-to-end, scaling Kubernetes, reducing latency, and ensuring reliability as real-time AI workloads evolve.

The role emphasizes diagnosing GPU/network bottlenecks, building robust failover, and enabling faster model launches with cost-efficient compute. A small, ownership-driven team environment awaits.

Qualifications

• Hands-on LLM inference serving experience.
• Kubernetes at production scale experience.
• Experience with high-performance networking (InfiniBand/RDMA) is a plus.
• Strong reliability and observability instincts.

Responsabilités

• Own the production inference platform end-to-end.
• Scale Kubernetes to meet throughput and latency targets.
• Build failover and self-healing systems.
• Diagnose GPU/network bottlenecks impacting performance.
• Ensure model improvements translate into faster, more reliable production systems.

Connaissances

LLM inference serving

Kubernetes at production scale

High-performance networking

Reliability & observability

Outils

Kubernetes

InfiniBand / RDMA

Description du poste

Salient Group is building the infrastructure behind demanding model-serving workloads in San Francisco. You will own the production inference platform end-to-end, scaling Kubernetes, reducing latency, and ensuring reliability as real-time AI workloads evolve.

The role emphasizes diagnosing GPU/network bottlenecks, building robust failover, and enabling faster model launches with cost-efficient compute. A small, ownership-driven team environment awaits.