Machine Learning Inference Engineer

Oscar; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

401k matching

Medical coverage

Job summary

Oscar is hiring a Senior Machine Learning Inference Engineer for a full-time role in the San Francisco Bay Area. You will focus on improving efficiency for AI-native infrastructure powering generative and multimodal models, with significant ownership over production inference systems.

The ideal candidate has 3+ years of professional experience, deep GPU infrastructure knowledge, and strong Python and PyTorch skills. This hybrid role offers full benefits and equity.

Qualifications

• 3+ years of professional ML experience.
• Strong GPU infrastructure knowledge with Triton, TensorRT, or vLLM.
• Proficiency in Python and PyTorch.
• Experience building model-serving microservices.
• Diffusion and multimodal model experience is a plus.

Responsibilities

• Improve efficiency of AI-native infrastructure for generative and multimodal models.
• Own inference systems and monitor model performance in production.
• Collaborate across teams to optimize deployment and scaling.

Skills

GPU infrastructure

Python

PyTorch

Triton

TensorRT

vLLM

Microservices

Diffusion

Multimodal

AI at scale

Job description

An AI Unicorn startup is hiring a Senior Machine Learning Inference Engineer for a full-time role.

You will be responsible for improving efficiency for AI-native infrastructure powered by generative and multimodal models. The ideal candidate has over 3 years of professional experience and a strong understanding of GPU infrastructure, Python, and PyTorch. This is a highly autonomous role with significant ownership across inference systems and model performance in production.

This role is hybrid in San Francisco Bay Area and offers full benefits and equity.

Experience:

• Building AI applications at scale from the ground up
• Strong understanding of GPU infrastructure including Triton, TensorRT, or vLLM frameworks
• Hands-on experience with Python and PyTorch
• Building model-serving Microservices
• Diffusion and Multimodal model experience is a plus
• Equity
• $401k matching
• Medical coverage