Production ML Engineer: Inference, Deployment & Monitoring

Quantum Technologies. LLC; San Jose (CA); Hybrid; USD 140,000 - 200,000; Full time

Job summary

Quantum Technologies. LLC is looking for a Machine Learning Engineer to own the end-to-end ML model lifecycle from post-training through production, including benchmarking, deployment, monitoring, and integration into live production applications.

You will work with ML researchers, production engineers, and platform teams in a fast-moving hybrid cloud environment on inference, deployment automation, and production integration with Java-based streaming pipelines.

Qualifications

• Strong foundation in ML inference, deployment, and quality testing.
• Ramp up quickly on new and unfamiliar tech stacks—this is the single most important trait.
• End-to-end problem-solving mindset—can own a problem from model handoff to user-facing behavior.
• Core ML knowledge sufficient to benchmark models and collaborate with researchers.
• Experience deploying models in cloud environments, ideally GCP.

Responsibilities

• Evaluate and benchmark new ML inference frameworks to guide production decisions
• Deploy models to GCP and integrate them into production applications and Java-based streaming pipelines
• Own deployment automation end-to-end — from model handoff through live serving
• Monitor how models behave in production for real end-users Performance & Quality
• Design and execute benchmarking, performance testing, and quality testing on ML models
• Perform model sampling to support quality evaluation and researcher feedback loops
• Debug issues across the full stack — from inference layer down to streaming pipelines
• Partner with ML researchers to provide benchmarking feedback and guide inference decisions — requires enough core ML knowledge to have a meaningful technical handshake
• Adapt rapidly to non-standard and evolving tech stacks across hybrid (on-prem + GCP) infrastructure

Skills

ML inference

Deployment

Quality testing

GCP

End-to-end solving

Tools

TensorFlow

PyTorch

JAX

Java

Job description

Quantum Technologies. LLC is looking for a Machine Learning Engineer to own the end-to-end ML model lifecycle from post-training through production, including benchmarking, deployment, monitoring, and integration into live production applications.

You will work with ML researchers, production engineers, and platform teams in a fast-moving hybrid cloud environment on inference, deployment automation, and production integration with Java-based streaming pipelines.