Senior AI Inference Engineer - Scale APIs

AssemblyAI, Inc.; Miami (FL); On-site; USD 190,000 - 225,000; Full time

Job summary

AssemblyAI, Inc. is hiring a Software Engineer to turn cutting-edge AI research into scalable products our customers rely on daily.

You’ll join a fast-paced engineering team between research and applied groups, turning new model capabilities into robust, production-ready APIs. You’ll design and ship customer-facing APIs, scale inference infrastructure to support 1M+ users, and collaborate with researchers to productionize techniques, ensuring latency, reliability, and excellent developer

Qualifications

• Strong backend engineering experience building production-grade systems.
• Experience with ML infrastructure or serving APIs in production.
• Ability to design robust, scalable APIs for model capabilities.
• Comfort collaborating across research and applied teams.

Responsibilities

• Design and ship customer-facing APIs exposing new model capabilities, owning them from prototype through launch and iteration.
• Scale inference infrastructure to support 1M+ API users.
• Partner with researchers to productionize new techniques for latency and reliability.
• Work with customers and Applied teams to inform product design and research direction.
• Contribute across the stack including backend services, inference infrastructure, SDKs, and tooling.

Skills

Backend engineering

ML infrastructure

APIs

Production systems

Job description

AssemblyAI, Inc. is hiring a Software Engineer to turn cutting-edge AI research into scalable products our customers rely on daily.

You’ll join a fast-paced engineering team between research and applied groups, turning new model capabilities into robust, production-ready APIs. You’ll design and ship customer-facing APIs, scale inference infrastructure to support 1M+ users, and collaborate with researchers to productionize techniques, ensuring latency, reliability, and excellent developer