Senior ML Inference Engineer: Scale AI in Production

Oscar; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

401k matching

Medical coverage

Job summary

Oscar is hiring a Senior Machine Learning Inference Engineer for a full-time role in the San Francisco Bay Area. You will focus on improving efficiency for AI-native infrastructure powering generative and multimodal models, with significant ownership over production inference systems.

The ideal candidate has 3+ years of professional experience, deep GPU infrastructure knowledge, and strong Python and PyTorch skills. This hybrid role offers full benefits and equity.

Qualifications

• 3+ years of professional ML experience.
• Strong GPU infrastructure knowledge with Triton, TensorRT, or vLLM.
• Proficiency in Python and PyTorch.
• Experience building model-serving microservices.
• Diffusion and multimodal model experience is a plus.

Responsibilities

• Improve efficiency of AI-native infrastructure for generative and multimodal models.
• Own inference systems and monitor model performance in production.
• Collaborate across teams to optimize deployment and scaling.

Skills

GPU infrastructure

Python

PyTorch

Triton

TensorRT

vLLM

Microservices

Diffusion

Multimodal

AI at scale

Job description

Oscar is hiring a Senior Machine Learning Inference Engineer for a full-time role in the San Francisco Bay Area. You will focus on improving efficiency for AI-native infrastructure powering generative and multimodal models, with significant ownership over production inference systems.

The ideal candidate has 3+ years of professional experience, deep GPU infrastructure knowledge, and strong Python and PyTorch skills. This hybrid role offers full benefits and equity.