Production ML Engineer — Scale Real-Time AI in SF Office

Digital Waffle; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Digital Waffle in San Francisco is hiring an ML Engineer to take models from notebook to production and keep them performant, reliable and affordable at scale. You will own training, serving, evaluation and the plumbing underneath.

The role sits at the intersection of ML and engineering; strong Python and PyTorch experience, plus the engineering maturity to turn models into real product surfaces, are essential. Expect 5 days per week in office in SF.

Qualifications

• Strong Python and PyTorch experience with real production ML systems behind you.
• Experience with Hugging Face Transformers, modern training workflows and distributed training.
• Hands-on with model serving stacks (vLLM, TensorRT, Triton or equivalent) and GPU-level optimisation.
• Comfort with experiment tracking (MLflow, Weights & Biases) and reproducibility hygiene.
• Cloud experience (AWS, GCP or Azure) and modern infra tooling.

Responsibilities

• Train, fine-tune and serve models in production using Python and PyTorch.
• Build and maintain the inference stack: model serving, batching, caching, cost control.
• Stand up training infrastructure using Ray, Modal, SageMaker or similar.
• Work with vector databases for retrieval-heavy workloads.
• Build evaluation pipelines so model quality is measurable.
• Partner with product and AI engineers to ship features from research.

Skills

Python

PyTorch

ML systems

Experiment tracking

Tools

vLLM

Triton

Ray

Modal

SageMaker

Weaviate

Job description

Digital Waffle in San Francisco is hiring an ML Engineer to take models from notebook to production and keep them performant, reliable and affordable at scale. You will own training, serving, evaluation and the plumbing underneath.

The role sits at the intersection of ML and engineering; strong Python and PyTorch experience, plus the engineering maturity to turn models into real product surfaces, are essential. Expect 5 days per week in office in SF.