Realtime ML Inference Engineer — Scalable Serving

Yobi AI; New York (NY); Remote; USD 120,000 - 150,000; Full time

Benefits offered by this job

Competitive base salary

Meaningful equity

Annual bonus

Health, dental, vision plans

Unlimited PTO

401(k) with company match

Job summary

A leading Behavioral AI company is seeking a Machine Learning Engineer focused on inference and serving. In this role, you will design and optimize systems to operationalize AI models. The ideal candidate has deep expertise in model deployment, a strong low-latency mindset, and is proficient in languages like Go, Rust, or Java. You will work in either a fully remote or hybrid environment. Competitive salary and equity options are offered.

Qualifications

• Deep expertise in model deployment and production ML serving.
• Strong low-latency mindset and knowledge of inference optimization techniques.
• Operational maturity with monitoring, drift detection, and observability.

Responsibilities

• Build and scale production ML serving systems.
• Ensure low-latency inference by optimizing model graphs.
• Write robust, high-performance code.

Skills

Model deployment and production ML serving

Inference optimization techniques

High-performance code writing

Monitoring and drift detection

Understanding of custom runtimes

Applied ML reasoning

Tools

Go

Rust

C++

Java

Python

Job description

A leading Behavioral AI company is seeking a Machine Learning Engineer focused on inference and serving. In this role, you will design and optimize systems to operationalize AI models. The ideal candidate has deep expertise in model deployment, a strong low-latency mindset, and is proficient in languages like Go, Rust, or Java. You will work in either a fully remote or hybrid environment. Competitive salary and equity options are offered.