Senior Machine Learning Infrastructure Engineer

Morph; California (MO); On-site; USD 90,000 - 120,000; Full time

Job summary

Morph is looking for candidates with exceptional skills in infrastructure to manage high-uptime systems focused on GPU loads. The role requires deep knowledge of inference engines and experience with various infrastructures, including load balancers.

Your contributions to projects like vLLM or SGLang will be a valuable asset. Join us in tackling complex challenges in custom inference stacks.

Qualifications

• Deep experience with inference engines is essential.
• Prior contributions to vLLM or SGLang are a plus.
• Experience with traditional infrastructure like load balancers.

Responsibilities

• Design and manage systems to achieve high uptime.
• Serve custom inference stacks with irregular GPU loads.
• Work with various infrastructure types to meet challenging requirements.

Skills

Infrastructure design

GPU load management

Load balancers

Contribution to inference frameworks

Job description

Goal: 99.99% uptime

We serve custom inference stacks that have irregular GPU load.

We're looking for people that have done genuinely amazing work in infrastructure and are interested in a challenge, working with both traditional infrastructure such as load balancers, NLB, etc., as well as very different infrastructure around inference engines and GPU loads.

This is a role that will inherently require deep experience with inference engines.

Contributions to vLLM, SGLang, trtllm, or inference frameworks a plus.