Principal Engineer, Model Performance (Remote, Equity)

Runware

San Jose (CA)

Remote

USD 230,000 - 420,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Meaningful stock options
Remote-first with in-person retreats
Generous paid time off

Job summary

Runware is the AI inference platform that builds and runs its own infrastructure, end to end. As Principal Engineer, Model Performance you will own how fast and how cheaply every model runs—diffusion, video generation, speech, 3D and LLMs—across thousands of GPUs.

You will set the performance roadmap, write kernels, lead the Model Performance team, and collaborate with Sonic Inference Engine, infrastructure, hardware teams, and open-source communities to push latency and cost to Pareto-optimal

Qualifications

  • 10+ years in GPU, HPC or DL systems engineering with production-scale inference
  • Track record of shipping performance from reference to Pareto frontier on real hardware
  • Deep CUDA and GPU architecture expertise: kernels, memory, Tensor Cores
  • Production experience with major inference engines (TensorRT-LLM, vLLM, SGLang)

Responsibilities

  • Own inference performance end-to-end for image, video, audio, 3D and LLM workloads on every GPU generation
  • Set the model performance roadmap and prioritize models and hardware
  • Write and tune CUDA kernels and quantization formats; implement parallelism and batching strategies
  • Build production deployment pipelines for new open models from weights to deployment
  • Lead and mentor the Model Performance team while staying hands-on

Skills

GPU architecture
CUDA optimization
Python
PyTorch internals
Leadership
Mentoring
Benchmarking
Latency optimization

Tools

TensorRT-LLM
vLLM
SGLang
Triton

Job description

Runware is the AI inference platform that builds and runs its own infrastructure, end to end. As Principal Engineer, Model Performance you will own how fast and how cheaply every model runs—diffusion, video generation, speech, 3D and LLMs—across thousands of GPUs.

You will set the performance roadmap, write kernels, lead the Model Performance team, and collaborate with Sonic Inference Engine, infrastructure, hardware teams, and open-source communities to push latency and cost to Pareto-optimal

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Engineer, Model Performance — Remote Inference at Scale
Principal Engineer, Model Performance — Remote Inference at Scale

Runware • San Francisco (CA)

Remote
USD 180,000 - 280,000
Stock options
Remote-first culture
Flexible schedule
+1
Remote Principal Engineer, Inference Performance
Remote Principal Engineer, Inference Performance

Runware • Palo Alto (CA)

Remote
USD 260,000 - 380,000
Stock options
Remote-first culture
Generous PTO
Remote-First Principal Engineer, Inference Performance
Remote-First Principal Engineer, Inference Performance

Runware • United States

Remote
USD 250,000 - 420,000
Stock options
Remote-first
Generous PTO
+2
Remote Principal Engineer, Model Performance & Inference
Remote Principal Engineer, Model Performance & Inference

Speedrun Talent Network • United States

Remote
USD 250,000 - 350,000
Stock options
Remote-first culture
Generous PTO
+2
Principal Engineer, Model Performance
Principal Engineer, Model Performance

present of AI • United States

Remote
USD 140,000 - 210,000
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Speedrun Talent Network • United States

Remote
USD 250,000 - 350,000
Stock options
Remote-first culture
Generous PTO
+2
Performance Modeling Engineer, AI Inference Deployments (Senior/Principal)
Performance Modeling Engineer, AI Inference Deployments (Senior/Principal)

positron.ai • United States

Remote
USD 120,000 - 180,000
Remote-first
Company-provided computer
Medical, dental, and vision coverage
+4
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • San Jose (CA)

Remote
USD 230,000 - 420,000
Meaningful stock options
Remote-first with in-person retreats
Generous paid time off
Senior Software Engineer: Performance ML Inference (Remote)
Senior Software Engineer: Performance ML Inference (Remote)

positron.ai • United States

Remote
USD 150,000 - 230,000
Remote-first policy
Comprehensive benefits (medical, etc.)
Unlimited paid time off
+3
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • Palo Alto (CA)

Remote
USD 260,000 - 380,000
Stock options
Remote-first culture
Generous PTO