Senior AI Inference Engineer — Scale Production APIs

AssemblyAI, Inc.; Philadelphia (Philadelphia County); On-site; USD 190,000 - 225,000; Full time

Job summary

AssemblyAI, a fast-growing Voice AI company, is hiring a Software Engineer to turn cutting‑edge AI research into scalable products used by customers daily. You will operate between research and applied teams, delivering robust APIs and scalable infrastructure.

The role requires strong backend engineering with ML infra experience, a collaborative mindset, and a passion for building reliable systems that power production APIs at scale.

Qualifications

• Strong backend engineering experience with production ML infra and APIs.
• Comfort operating with ambiguity in timelines and priorities.
• Genuine curiosity about AI/ML to guide engineering decisions.
• Strong collaboration with researchers, engineers, and customers.

Responsibilities

• Design and ship customer-facing APIs exposing new model capabilities from prototype to launch.
• Scale inference infrastructure to support 1M+ API users.
• Productionize new techniques in collaboration with researchers.
• Work with customers and Applied teams to feed feedback into product and research direction.
• Contribute across the stack: backend services, inference infra, SDKs, internal tooling.

Skills

Backend engineering

ML infrastructure

Customer-facing APIs

Job description

AssemblyAI, a fast-growing Voice AI company, is hiring a Software Engineer to turn cutting‑edge AI research into scalable products used by customers daily. You will operate between research and applied teams, delivering robust APIs and scalable infrastructure.

The role requires strong backend engineering with ML infra experience, a collaborative mindset, and a passion for building reliable systems that power production APIs at scale.