Senior ML Inference Engineer — AI Infrastructure & Equity

Oscar Technology; San Francisco (CA); Hybrid; USD 225,000 - 275,000; Full time

Benefits offered by this job

Equity

401k matching

Medical coverage

Competitive base salary

Job summary

Oscar Associates Limited (US) in San Francisco offers a hybrid Senior ML Inference Engineer role. You will enhance AI-native infrastructure powering generative and multimodal models, with ownership across inference systems and production performance.

The ideal candidate has 3+ years of experience, strong Python and PyTorch skills, and familiarity with GPU tooling like Triton, TensorRT, and vLLM. Equity and full benefits accompany a competitive base salary.

Qualifications

• 3+ years of professional ML experience required.
• Strong understanding of GPU infrastructure for AI-native systems.
• Hands-on with Python and PyTorch; building model-serving microservices.

Responsibilities

• Improve efficiency of AI-native infrastructure for generative and multimodal models.
• Own inference systems and production model performance.
• Collaborate across teams to optimize deployment.
• Experience with diffusion and multimodal models is a plus.

Skills

GPU infra

Python

PyTorch

Triton

TensorRT

vLLM

Diffusion

Model-serving

Multimodal models

Tools

Triton

TensorRT

Job description

Oscar Associates Limited (US) in San Francisco offers a hybrid Senior ML Inference Engineer role. You will enhance AI-native infrastructure powering generative and multimodal models, with ownership across inference systems and production performance.

The ideal candidate has 3+ years of experience, strong Python and PyTorch skills, and familiarity with GPU tooling like Triton, TensorRT, and vLLM. Equity and full benefits accompany a competitive base salary.