Staff ML Infra / MLOps Engineer: Scale & Automate AI

Quince; Palo Alto (CA); On-site; USD 218,000 - 285,000; Full time

Job summary

Quince is seeking a Staff ML Engineer to join its growing ML Infra team in Palo Alto. You will architect and operate production-grade ML systems, from distributed training pipelines to high-throughput inference, ensuring extensibility and observability.

You will lead the developer experience for data scientists, drive CI/CD for ML, and mentor engineers while optimizing GPU usage and cost. A startup mindset with autonomy is essential.

Qualifications

• 8+ years in industry, with at least 4+ years in ML Infrastructure/MLOps or large-scale data platforms.
• Proven track record building MLOps platforms spanning data ingestion, distributed training, real-time inference, and governance.
• Deep expertise in cloud-native infra (AWS preferred), Kubernetes (EKS), Docker, and IaC tools (Terraform/Pulumi).
• Hands-on with ML frameworks (PyTorch, TensorFlow) and feature stores; strong opinions on developer experience for ML teams.

Responsibilities

• Architect and own end-to-end ML infrastructure design (training, serving, feature pipelines, monitoring) for modular, scalable platforms.
• Build a productive developer experience enabling data scientists to move from idea to production with minimal friction.
• Set and enforce ML CI/CD, IaC, model versioning, experiments, and deployment strategies (blue-green, canary).
• Lead platform evaluation and component selection (inference runtimes, feature stores, orchestration).
• Optimize GPU utilization, batching, and cloud costs for training and inference workloads.
• Ensure production scalability and reliability with robust monitoring, alerting, and automated recovery.
• Mentor junior engineers through reviews, pairing, and design discussions to raise the technical bar.
• Lead RCAs for production issues and drive systemic, permanent fixes with strong on-call discipline.

Skills

ML Infrastructure

MLOps

AWS

Kubernetes

Docker

Terraform/Pulumi

PyTorch/TensorFlow

Feature Stores

CI/CD for ML

On-call discipline

Tools

Kubeflow

SageMaker

Spark

Kafka

Job description

Quince is seeking a Staff ML Engineer to join its growing ML Infra team in Palo Alto. You will architect and operate production-grade ML systems, from distributed training pipelines to high-throughput inference, ensuring extensibility and observability.

You will lead the developer experience for data scientists, drive CI/CD for ML, and mentor engineers while optimizing GPU usage and cost. A startup mindset with autonomy is essential.