Senior AI Inference Engineer - Scale & APIs

AssemblyAI, Inc.; Greater London; On-site; GBP 120,000 - 145,000; Full time

Job summary

AssemblyAI is hiring a Software Engineer to transform cutting-edge AI research into production-ready APIs used by customers daily. You’ll bridge the research org and Applied teams, taking new model capabilities from proof of concept to scalable, well-documented APIs that handle production traffic at scale.

You will design customer-facing APIs, scale inference infrastructure for millions of users, and collaborate with researchers to turn notebooks into reliable, latency-conscious products.

Qualifications

• Strong backend engineering experience in production environments.
• Experience with ML infrastructure and APIs serving models at scale.
• Ability to design robust, customer-facing APIs and maintain them over time.

Responsibilities

• Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
• Scale inference infrastructure to support 1M+ API users.
• Collaborate with researchers to productionize new techniques and turn ideas into reliable systems.
• Understand how customers build with our products and feed insights back into product and research directions.
• Contribute across the stack including backend services, inference infra, SDKs, and internal tooling.

Skills

Backend engineering

ML infra

Production APIs

Collaboration

Job description

AssemblyAI is hiring a Software Engineer to transform cutting-edge AI research into production-ready APIs used by customers daily. You’ll bridge the research org and Applied teams, taking new model capabilities from proof of concept to scalable, well-documented APIs that handle production traffic at scale.

You will design customer-facing APIs, scale inference infrastructure for millions of users, and collaborate with researchers to turn notebooks into reliable, latency-conscious products.