Senior Inference Engineer: Build Production-Grade AI APIs

AssemblyAI, Inc.; Washington (District of Columbia); On-site; USD 190,000 - 225,000; Full time

Job summary

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into products our customers rely on daily. You’ll sit on a fast-paced engineering team between research and applied groups, turning new model capabilities into robust, well-documented APIs serving production traffic at scale.

You will design and ship customer-facing APIs, scale inference infrastructure for 1M+ users, and work with researchers to productionize techniques while ensuring latency and reliability.

Qualifications

• Strong backend engineering experience, including building ML infrastructure in production.
• Experience designing customer-facing APIs and scaling services.
• Comfort operating with ambiguity and shifting timelines.
• Curiosity about AI/ML to make informed engineering decisions.

Responsibilities

• Design and ship customer-facing APIs exposing new model capabilities.
• Scale inference infrastructure to support 1M+ API users.
• Productionize new research techniques with latency and reliability in mind.
• Collaborate with researchers, applied engineers, and customers to shape product direction.
• Contribute across the stack including backend services, tooling, and SDKs.

Skills

Backend engineering

APIs design

ML infra experience

Ambiguity tolerance

Collaboration

Production-grade software

Tools

APIs

SDKs

ML infrastructure

Job description

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into products our customers rely on daily. You’ll sit on a fast-paced engineering team between research and applied groups, turning new model capabilities into robust, well-documented APIs serving production traffic at scale.

You will design and ship customer-facing APIs, scale inference infrastructure for 1M+ users, and work with researchers to productionize techniques while ensuring latency and reliability.