Lead GPU Inference & ML Infrastructure Engineer

Avride Inc.

Austin (TX)

On-site

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Avride is seeking a software engineer with leadership experience to drive the ML infrastructure layer across the company. You will lead GPU inference optimization for onboard and high-throughput offboard scenarios, while guiding broader ML infrastructure across pipelines.

The role requires deep C++ experience, strong multi-threading skills, and collaboration with the applied ML team to align neural model architectures with performance goals.

Qualifications

  • Experience with PyTorch and GPU architectures.
  • Proven ability to diagnose and resolve performance issues in large systems.
  • Strong track record building distributed infrastructure.

Responsibilities

  • Own the GPU inference framework with a focus on performance.
  • Take ownership of broader ML infrastructure across pipelines.
  • Collaborate with the applied ML team on model architecture and deployment.

Skills

PyTorch
GPUs
Performance debugging
Infrastructure
C++
Multi-threading

Job description

Avride is seeking a software engineer with leadership experience to drive the ML infrastructure layer across the company. You will lead GPU inference optimization for onboard and high-throughput offboard scenarios, while guiding broader ML infrastructure across pipelines.

The role requires deep C++ experience, strong multi-threading skills, and collaboration with the applied ML team to align neural model architectures with performance goals.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Infrastructure Engineer
Lead AI Infrastructure Engineer

Avride Inc. • Austin (TX)

On-site
USD 140,000 - 190,000
Senior Inference Engine Engineer - GPU Kernel & ML Runtime
Senior Inference Engine Engineer - GPU Kernel & ML Runtime

FriendliAI Inc. • San Francisco (CA)

On-site
USD 190,000 - 270,000
Flexible hours
Lunch/dinner provided
Collaborative environment
+4
Robotics ML Infra Engineer: GPU Fleet & Inference
Robotics ML Infra Engineer: GPU Fleet & Inference

Generalist AI, Inc. • Boston (MA)

On-site
USD 150,000 - 230,000
Lead GPU Inference Performance Engineer
Lead GPU Inference Performance Engineer

present of AI • United States

Remote
USD 140,000 - 210,000
Senior ML Inference Engineer — Scalable GPU Backend
Senior ML Inference Engineer — Scalable GPU Backend

Cavendish Professionals • Mountain View (CA)

On-site
GBP 90,000 - 150,000
Lead Inference Engineer — AI Serving & GPU Optimization
Lead Inference Engineer — AI Serving & GPU Optimization

Aleroy • United States

Remote
USD 140,000 - 190,000
Lead Inference Systems Engineer - AI Serving
Lead Inference Systems Engineer - AI Serving

adaption • United States

Hybrid
USD 180,000 - 280,000
Flexible work
Travel stipend
Lunch stipend
+1
Tech Lead - AI Inference
Tech Lead - AI Inference

wekatest • United States

Remote
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+5
Remote Deep Learning Inference Engineering Lead
Remote Deep Learning Inference Engineering Lead

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Hybrid work arrangement
Senior AI/ML Capacity & Performance Engineer (Hybrid)
Senior AI/ML Capacity & Performance Engineer (Hybrid)

General Motors Company • Sunnyvale (CA)

Hybrid
USD 145,000 - 261,000
Health benefits
Retirement savings plan
GM vehicle discounts