Senior ML Inference Engineer — Scale Production APIs

AssemblyAI, Inc.; New York (NY); On-site; USD 190,000 - 225,000; Full time

Job summary

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products used by customers daily. You’ll work on a fast-paced team bridging research, applied engineering, and customer-facing APIs, delivering model capabilities at scale.

You will design APIs, scale inference infrastructure, and collaborate with researchers to turn notebooks into robust, reliable services that power production traffic.

Qualifications

• Experience building ML infrastructure in production.
• Ability to design and ship customer-facing APIs.
• Comfort operating with ambiguity in timelines and goals.
• Strong collaboration with researchers, engineers and customers.

Responsibilities

• Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
• Scale inference infrastructure to support 1M+ API users.
• Productionize new techniques with latency, reliability and ergonomics in mind.
• Collaborate with researchers and applied engineers to feed user feedback into product direction.
• Contribute across the stack: backend services, inference infra, SDKs, internal tooling.

Skills

Backend engineering

ML infrastructure

APIs

Collaboration

Ambiguity tolerance

Curiosity about AI/ML

Tools

APIs

SDKs

Internal tooling

Job description

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products used by customers daily. You’ll work on a fast-paced team bridging research, applied engineering, and customer-facing APIs, delivering model capabilities at scale.

You will design APIs, scale inference infrastructure, and collaborate with researchers to turn notebooks into robust, reliable services that power production traffic.