Senior Principal ML Engineer — Inference Frameworks (Onsite)

MemWize, Inc; Sunnyvale, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Memwize is a VC-backed stealth-mode startup located in Sunnyvale, CA, seeking a Senior/Principal Machine Learning Engineer to drive performance improvements in inference frameworks and develop advanced cluster scheduling algorithms.

The role focuses on optimizing throughput and latency for rack-level AI inference systems, working with vLLM, SGLang, and PyTorch in a hands-on capacity. Onsite full-time in Sunnyvale, CA with collaboration across ML and infrastructure teams.

Qualifications

• Experience in building and optimizing ML inference frameworks.
• Strong understanding of performance profiling and optimization techniques.
• Experience with cluster scheduling algorithms for large-scale inference clusters.

Responsibilities

• Improve performance of inference frameworks such as vLLM, SGLang, and PyTorch.
• Develop and optimize cluster scheduling algorithms to maximize throughput and minimize latency.
• Collaborate with infra and ML teams to deploy scalable inference solutions and monitor performance.

Skills

vLLM

SGLang

PyTorch

Job description

Memwize is a VC-backed stealth-mode startup located in Sunnyvale, CA, seeking a Senior/Principal Machine Learning Engineer to drive performance improvements in inference frameworks and develop advanced cluster scheduling algorithms.

The role focuses on optimizing throughput and latency for rack-level AI inference systems, working with vLLM, SGLang, and PyTorch in a hands-on capacity. Onsite full-time in Sunnyvale, CA with collaboration across ML and infrastructure teams.