ML Inference Infrastructure Architect

Morph; California (MO); On-site; USD 90,000 - 120,000; Full time

Job summary

Morph is looking for candidates with exceptional skills in infrastructure to manage high-uptime systems focused on GPU loads. The role requires deep knowledge of inference engines and experience with various infrastructures, including load balancers.

Your contributions to projects like vLLM or SGLang will be a valuable asset. Join us in tackling complex challenges in custom inference stacks.

Qualifications

• Deep experience with inference engines is essential.
• Prior contributions to vLLM or SGLang are a plus.
• Experience with traditional infrastructure like load balancers.

Responsibilities

• Design and manage systems to achieve high uptime.
• Serve custom inference stacks with irregular GPU loads.
• Work with various infrastructure types to meet challenging requirements.

Skills

Infrastructure design

GPU load management

Load balancers

Contribution to inference frameworks

Job description

Morph is looking for candidates with exceptional skills in infrastructure to manage high-uptime systems focused on GPU loads. The role requires deep knowledge of inference engines and experience with various infrastructures, including load balancers.

Your contributions to projects like vLLM or SGLang will be a valuable asset. Join us in tackling complex challenges in custom inference stacks.