Low-Latency ML Inference Engineer (GPU/ Production)

Priorslab

Bala Cynwyd (PA)

On-site

USD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Priorslab in Bala Cynwyd, PA is seeking a Machine Learning Engineer focused on fast inference to build, tune, and productionize high-performance model serving systems. You will collaborate with researchers and engineers to identify bottlenecks, optimize transformer-style architectures, and evaluate inference runtimes.

The role involves GPUs, memory layouts, and end-to-end latency constraints in production systems.

Qualifications

  • Experience deploying ML inference workloads in production or production-like environments.
  • Proficiency in Python and a systems language (C/C++, Rust, or Go).
  • Solid understanding of ML frameworks such as PyTorch, with profiling knowledge.
  • Ability to reason about latency, throughput, batching, memory use, GPU utilization, and reliability.

Responsibilities

  • Design, build, and optimize low-latency inference systems for production workloads.
  • Profile inference pipelines across execution, runtime config, batching, memory, IO, and networking.
  • Evaluate and tune inference runtime systems and deployment strategies.
  • Improve latency and GPU utilization for production workloads.
  • Develop benchmarking/profiling tools to compare variants and hardware targets.
  • Debug GPU memory, compute saturation, kernel behavior, CPU/GPU coordination, data movement.

Skills

Python
Java
C/C++
Rust
Go
PyTorch
Performance profiling
Latency optimization

Education

Bachelor's degree in CS/CE or related field

Tools

CUDA
Triton
Kubernetes
GPU clusters

Job description

Priorslab in Bala Cynwyd, PA is seeking a Machine Learning Engineer focused on fast inference to build, tune, and productionize high-performance model serving systems. You will collaborate with researchers and engineers to identify bottlenecks, optimize transformer-style architectures, and evaluate inference runtimes.

The role involves GPUs, memory layouts, and end-to-end latency constraints in production systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Low-Latency ML Inference Engineer
Low-Latency ML Inference Engineer

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 150,000 - 230,000
Low-Latency ML Inference Engineer
Low-Latency ML Inference Engineer

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
Senior ML Engineer - Production Inference & Low-Latency AI
Senior ML Engineer - Production Inference & Low-Latency AI

Cloudflare, Inc. • New York (NY)

Hybrid
USD 194,000 - 266,000
Medical Insurance
Dental Insurance
Vision Insurance
+2
Machine Learning Engineer- Inference Optimization | Experienced Hire
Machine Learning Engineer- Inference Optimization | Experienced Hire

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 150,000 - 230,000
ML Inference Performance Engineer — Ultra-Low Latency
ML Inference Performance Engineer — Ultra-Low Latency

Priorslab • New York (NY)

Hybrid
USD 200,000 - 300,000
Hybrid working opportunities
Free breakfast, lunch, and snacks
Wellness reimbursement
+2
ML Optimization Engineer: Training & Inference on GPUs
ML Optimization Engineer: Training & Inference on GPUs

Generalist • Somerville (NJ)

On-site
USD 150,000 - 210,000
Inference Optimization Engineer: Fast, Cost-Effective ML
Inference Optimization Engineer: Fast, Cost-Effective ML

Build AI • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive pay
Medical, dental, and vision packages
Housing subsidy $2k/month near SF offi
+6
Inference Systems Engineer: Low-Latency, On-Device
Inference Systems Engineer: Low-Latency, On-Device

Genesis • San Carlos (CA)

On-site
USD 180,000 - 240,000
ML Performance Engineer: Production GPU Optimizer
ML Performance Engineer: Production GPU Optimizer

Goliath Partners Inc. • New York (NY)

On-site
USD 200,000 - 300,000
Machine Learning Engineer- Inference Optimization | Experienced Hire
Machine Learning Engineer- Inference Optimization | Experienced Hire

Priorslab • Bala Cynwyd (PA)

On-site
USD 150,000 - 210,000