Senior LLM Inference Systems Engineer

Snowflake

Menlo Park (CA)

Presencial

USD 236.000 - 310.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Bonus and equity plan
Medical, dental, vision insurance
401(k) retirement plan
Paid holidays

Descripción de la vacante

Snowflake is seeking talented systems developers and researchers to advance LLM inference systems and optimization. You will design high-performance, intelligent inference stacks spanning distributed serving, runtime systems, and GPU kernels, collaborating with model researchers and product teams.

The role emphasizes AI-native engineering to accelerate both model performance and inference development, with opportunities to publish innovations and contribute to production-scale AI.

Formación

  • Bachelors in CS/EE; advanced degree preferred.
  • 5+ years in LLM inference or distributed AI.
  • Experience with LLM architectures and serving tradeoffs.
  • Hands-on with LLM inference frameworks (e.g., vLLM, TensorRT-LLM).
  • Familiarity with GPU programming (CUDA, Triton).

Responsabilidades

  • Design high-performance LLM inference systems across devices.
  • Develop techniques to reduce latency and improve throughput.
  • Explore adaptive parallelism, decoding, disaggregation, batching, KV-cache.
  • Build adaptive inference systems for new models and hardware.
  • Apply AI-native engineering to profiling, configuration search, and optimization.
  • Identify bottlenecks and drive solutions from research to production.
  • Design distributed inference across GPUs and nodes.
  • Develop multi-model serving, dynamic resource management, model loading.
  • Profile GPUs and operators for attention, MoE, etc.
  • Collaborate with researchers, infra, product; publish innovations.
  • Open-source contributions and blogs.

Conocimientos

LLM inference
Distributed AI
GPU systems
Performance optimization
System scalability
AI-native engineering

Educación

Bachelor's degree in CS/EE
Master's or PhD preferred

Herramientas

CUDA
Triton
TensorRT-LLM
vLLM
SGLang
cuDNN
cuBLAS
CUTLASS
Nsight

Descripción del empleo

Snowflake is seeking talented systems developers and researchers to advance LLM inference systems and optimization. You will design high-performance, intelligent inference stacks spanning distributed serving, runtime systems, and GPU kernels, collaborating with model researchers and product teams.

The role emphasizes AI-native engineering to accelerate both model performance and inference development, with opportunities to publish innovations and contribute to production-scale AI.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Snowflake • Menlo Park (CA)

Presencial
USD 236.000 - 310.000
Medical insurance
Bonus & equity plan
401(k) retirement plan
+1
Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Aimlroles • Bellevue (WA)

Presencial
USD 180.000 - 270.000
Senior AI Systems Engineer - LLM Inference & Performance
Senior AI Systems Engineer - LLM Inference & Performance

Fdetimes • Bellevue (WA)

Presencial
USD 180.000 - 280.000
Senior AI Systems Research Engineer - LLM Inference
Senior AI Systems Research Engineer - LLM Inference

Snowflake • Bellevue (WA)

Presencial
USD 236.000 - 310.000
Bonus and equity plan
Senior/Staff System Research Engineer – LLM Inference Optimization
Senior/Staff System Research Engineer – LLM Inference Optimization

FDE Times • Bellevue (WA)

Presencial
USD 180.000 - 280.000
Senior/Staff System Research Engineer – LLM Inference Optimization
Senior/Staff System Research Engineer – LLM Inference Optimization

Aimlroles • Bellevue (WA)

Presencial
USD 180.000 - 270.000
Senior/Staff Software Engineer – LLM Inference & Reinforcement Learning Platform
Senior/Staff Software Engineer – LLM Inference & Reinforcement Learning Platform

Precision Labs • Bellevue (WA)

Híbrido
USD 180.000 - 260.000
Senior/Staff System Research Engineer – LLM Inference Optimization
Senior/Staff System Research Engineer – LLM Inference Optimization

Snowflake • Menlo Park (CA)

Presencial
USD 236.000 - 310.000
Bonus and equity plan
Medical, dental, vision insurance
401(k) retirement plan
+1
Senior/Staff System Research Engineer – LLM Inference Optimization
Senior/Staff System Research Engineer – LLM Inference Optimization

Snowflake • Bellevue (WA)

Presencial
USD 236.000 - 310.000
Bonus and equity plan
LLM Inference Systems Engineer
LLM Inference Systems Engineer

Netpreme • Santa Clara (CA), Boston (MA)

Presencial
USD 170.000 - 210.000
Competitive salary with bonus
Health, Dental, and Vision for you and
401(k) match with immediate vesting
+7