Senior Principal LLM Bring-up Engineer

SambaNova, Inc.; Austin (TX); Sur place; USD 208 000 - 312 000; Plein temps

Avantages offerts par ce poste

Equity

Health insurance

HSA

Dental

Vision

Disability insurance

Life insurance

FSA

Headspace

Gympass+

One Medical

Employee Assistance Program

Résumé du poste

SambaNova Systems in Austin, TX, seeks a senior ML systems engineer to bring open-weight LLMs onto our RDU accelerators and production serving. You will map models across chips and hosts, compile, and validate numerically against references while meeting latency and throughput targets.

You will build shared inference features like continuous batching, FP8/FP4 support, and multi-host scaling to reduce model bring-up costs and enable rapid deployment.

Qualifications

• B.S. in Computer Science, Electrical Engineering, or related field.
• 8+ years of industry experience in ML systems, inference, or compiler engineering.
• Strong Python and PyTorch internals experience, plus some C++.
• Deep transformer-inference knowledge, including KV caching, GQA and sliding window attention, MoE routing, prefill vs decode, batching, and speculative decoding.
• Hands-on experience with accelerator bring-up, ML compilers (MLIR, XLA, TVM, Triton, torch-mlir), or inference engines (vLLM, SGLang, TensorRT-LLM).
• Rigor in numerical debugging.
• Comfort with Bazel, Slurm, and large monorepos.
• Clear writing and evidence-backed claims.

Responsabilités

• Bring up new LLM architectures end to end: model adaptation, checkpoint conversion, multi-chip / multi-host mapping, compile, strict numerical validation, production serving with latency / throughput numbers.
• Build inference features once as shared modules: continuous batching over a paged KV pool, prompt caching, chunked and incremental prefill, dynamic tensor shapes, speculative decoding (EAGLE-3, drafters, MTP), FP8 / FP4, tensor and expert parallelism.
• Debug where model, compiler and hardware meet; land each fix in the right shared component.

Connaissances

Python

PyTorch internals

C++

Transformer inference

ML systems

Formation

B.S. in Computer Science, Electrical Engineering, or related field

Outils

MLIR

XLA

TVM

Triton

torch-mlir

Description du poste

SambaNova Systems in Austin, TX, seeks a senior ML systems engineer to bring open-weight LLMs onto our RDU accelerators and production serving. You will map models across chips and hosts, compile, and validate numerically against references while meeting latency and throughput targets.

You will build shared inference features like continuous batching, FP8/FP4 support, and multi-host scaling to reduce model bring-up costs and enable rapid deployment.