Sr/ Principal Machine Learning Engineer — Inference Frameworks

MemWize, Inc; Sunnyvale, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Memwize is a VC-backed stealth-mode startup located in Sunnyvale, CA, seeking a Senior/Principal Machine Learning Engineer to drive performance improvements in inference frameworks and develop advanced cluster scheduling algorithms.

The role focuses on optimizing throughput and latency for rack-level AI inference systems, working with vLLM, SGLang, and PyTorch in a hands-on capacity. Onsite full-time in Sunnyvale, CA with collaboration across ML and infrastructure teams.

Qualifications

• Experience in building and optimizing ML inference frameworks.
• Strong understanding of performance profiling and optimization techniques.
• Experience with cluster scheduling algorithms for large-scale inference clusters.

Responsibilities

• Improve performance of inference frameworks such as vLLM, SGLang, and PyTorch.
• Develop and optimize cluster scheduling algorithms to maximize throughput and minimize latency.
• Collaborate with infra and ML teams to deploy scalable inference solutions and monitor performance.

Skills

vLLM

SGLang

PyTorch

Job description

Sr/ Principal Machine Learning Engineer — Inference Frameworks

Memwize is a VC-backed, stealth-mode startup building rack-level AI inference systems .

We are seeking an experienced Senior/Principal Machine Learning Engineer to drive performance improvements in inference frameworks ( vLLM , SGLang , PyTorch ) and develop advanced cluster scheduling algorithms to optimize throughput and latency.

Will you now or in the future require visa sponsorship to work in the United States? * Select...

Are you available to work onsite full-time at our Sunnyvale, CA office? *