Senior ML Inference Engineer — Real-Time Systems

Sanas; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Sanas is building real-time speech and language models deployed on-premise inside sovereign data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads.

As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role is in the SF Bay Area with hands-on impact in a fast-growing startup.

Qualifications

• 5+ years of high-performance software development experience.
• Strong familiarity with NVIDIA GPU architecture and CUDA.
• Experience with the LLM serving stack from kernels to autoscaling.
• Background in LLM/Speech-to-Text/Text-to-Speech inference is preferred.
• Record of shipping research or systems usable by others.

Responsibilities

• Optimize system and GPU performance for high-throughput AI workloads.
• Analyze latency, throughput, memory, and compute efficiency.
• Profile and fix GPU- and kernel-level bottlenecks.
• Own and evolve the inference engine for reliability at scale.

Skills

High-performance coding

CUDA familiarity

LLM serving stack

Speech/LLM inference

Research/Systems shipping

Tools

Kubernetes

InfiniBand

RoCE

Bare-metal provisioning

Distributed storage

Job description

Sanas is building real-time speech and language models deployed on-premise inside sovereign data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads.

As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role is in the SF Bay Area with hands-on impact in a fast-growing startup.