Senior Inference Engineer: Remote GPU-Accelerated AI Deployment

Pika

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Equity
Health benefits
Collaborative culture

Job summary

Pika, a Palo Alto–based AI startup, is seeking Senior/Staff Inference Engineers to accelerate AI-driven products. You will design and optimize inference pipelines, implement state‑of‑the‑art acceleration techniques, and collaborate with researchers to push real-time video and language models to production.

You’ll maximize GPU parallelism using CUDA and NCCL, develop high‑performance kernels, and contribute to model deployment and training efficiency.

Qualifications

  • 5+ years engineering experience in inference acceleration and deployment at scale.
  • Expertise in inference optimization, quantization, and attention acceleration.
  • Strong GPU programming experience with CUDA and NCCL.
  • Familiarity with videogen models and large language models.
  • Excellent cross-discipline collaboration and ownership mindset.

Responsibilities

  • Accelerate inference using advanced acceleration techniques.
  • Maximize GPU parallelism across tensor, sequence, and pipeline parallelism.
  • Develop high-performance kernels and distributed workloads with CUDA/NCCL.
  • Advance AI deployment of videogen and LLMs into production.
  • Improve training efficiency and participate in code reviews.

Skills

Inference acceleration
GPU programming
CUDA
NCCL
Distributed inference
Quantization
Model deployment
Collaboration

Tools

CUDA
NCCL

Job description

Pika, a Palo Alto–based AI startup, is seeking Senior/Staff Inference Engineers to accelerate AI-driven products. You will design and optimize inference pipelines, implement state‑of‑the‑art acceleration techniques, and collaborate with researchers to push real-time video and language models to production.

You’ll maximize GPU parallelism using CUDA and NCCL, develop high‑performance kernels, and contribute to model deployment and training efficiency.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer, Inference & Optimization
ML Engineer, Inference & Optimization

Pika • United States

Remote
USD 180,000 - 260,000
Competitive salary
Equity
Health benefits
+1
Lead GPU Inference Performance Engineer
Lead GPU Inference Performance Engineer

present of AI • United States

Remote
USD 140,000 - 210,000
Senior AI Inference Systems Engineer
Senior AI Inference Systems Engineer

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 224,000 - 431,250
Equity
Benefits
Senior Architect, Scaled AI Inference & GPU Acceleration
Senior Architect, Scaled AI Inference & GPU Acceleration

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits package
Staff GPU Inference Engineer — Production AI Acceleration
Staff GPU Inference Engineer — Production AI Acceleration

Cerebras • Sunnyvale (CA)

On-site
USD 250,000 - 360,000
Breakthrough AI platform
Open source research
Work on one of the fastest AI superwec
+2
Remote Senior AI Inference Optimization Engineer
Remote Senior AI Inference Optimization Engineer

DigitalOcean • San Francisco (CA)

Remote
USD 191,200 - 239,000
Equity compensation
Remote work
Lead Inference Engineer — AI Serving & GPU Optimization
Lead Inference Engineer — AI Serving & GPU Optimization

Aleroy • United States

Remote
USD 140,000 - 190,000
Senior AI Inference Architect — Equity & Scalable GPU Solutions
Senior AI Inference Architect — Equity & Scalable GPU Solutions

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 356,000
Equity
Comprehensive benefits
Staff Inference Engineer — GPU-Optimized ML Serving
Staff Inference Engineer — GPU-Optimized ML Serving

Uniphore • Palo Alto (CA)

On-site
USD 190,000 - 240,000
Annual incentive
Pre-IPO stock options
Medical, dental, vision
+2
Senior AI Inference Optimization Engineer
Senior AI Inference Optimization Engineer

DigitalOcean • Seattle (WA)

Hybrid
USD 191,000 - 239,000