Platform Engineer - Scalable ML Inference

Menlo Ventures; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive compensation

Ownership culture

World-class team

Job summary

Chai Discovery is building a design suite for molecules and AI-driven biology. Platform engineers own the serving stack that makes frontier models fast, reliable, and scalable across a multi-cloud GPU fleet.

You'll optimize latency, throughput, and GPU efficiency, and turn models into product-ready pipelines used by researchers. You'll work with researchers, product engineers, and the commercial team to ship systems that researchers depend on and to drive observability, incident

Qualifications

• 4+ years building production systems with depth in performance, distributed systems, or ML serving.
• Experience optimizing model inference: GPU utilization, batching, quantization, caching, or kernel-level work.
• A platform mindset: you like building the tools and abstractions that make other engineers and researchers faster.
• End-to-end ownership of 24/7 systems, including observability, alerting, and incident response.
• Experience across both 0-to-1 buildouts and 1-to-n scale-ups, with an always-evolving playbook you bring wherever you go.
• The instinct to treat cost and efficiency as first-class constraints, not afterthoughts.

Responsibilities

• Own the serving stack that turns frontier models into a product researchers depend on: latency, throughput, GPU efficiency, batching, and autoscaling across a large multi-cloud GPU fleet.
• Contribute to pipelines and observability tooling that lets researchers ship faster.
• Work closely with researchers, product engineers, and the commercial team deploying them to the world's largest pharma companies.
• Drive reliability and performance in production systems with 24/7 uptime.
• Collaborate to continuously evolve the platform with a focus on cost efficiency.

Skills

Production systems

GPU optimization

Platform mindset

Observability & incident response

End-to-end ownership

Cost optimization

Job description

Chai Discovery is building a design suite for molecules and AI-driven biology. Platform engineers own the serving stack that makes frontier models fast, reliable, and scalable across a multi-cloud GPU fleet.

You'll optimize latency, throughput, and GPU efficiency, and turn models into product-ready pipelines used by researchers. You'll work with researchers, product engineers, and the commercial team to ship systems that researchers depend on and to drive observability, incident