Senior AI Infrastructure & API Engineer

AssemblyAI

New York (NY)

On-site

USD 190,000 - 225,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products. You will join a fast-paced engineering team bridging research and applied teams to deliver model capabilities via robust APIs for production traffic at scale.

The role emphasizes building customer-facing APIs, scaling inference infrastructure, and partnering with researchers. You’ll work across the stack and collaborate with customers to inform product direction in a merit-driven environment.

Qualifications

  • Backend engineering experience building and supporting production APIs or ML infrastructure.
  • Interest in AI/ML and ability to reason about models to make engineering decisions.
  • Experience collaborating with researchers, applied engineers, and customers.
  • Ability to work across the stack and contribute to backend services, tooling, and infrastructure.

Responsibilities

  • Design and ship customer-facing APIs exposing new model capabilities from prototype to launch.
  • Scale inference infrastructure to support 1M+ API users.
  • Partner with researchers to productionize new techniques, turning experiments into scalable features.
  • Work with customers and applied teams to understand usage and feed insights into product direction.
  • Contribute across the stack: backend services, inference infra, SDKs, internal tooling.

Skills

Backend engineering
ML infrastructure
APIs in production
Cross-functional collaboration
Comfort with ambiguity

Job description

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products. You will join a fast-paced engineering team bridging research and applied teams to deliver model capabilities via robust APIs for production traffic at scale.

The role emphasizes building customer-facing APIs, scaling inference infrastructure, and partnering with researchers. You’ll work across the stack and collaborate with customers to inform product direction in a merit-driven environment.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer - ML Infra & Production APIs
Senior Software Engineer - ML Infra & Production APIs

AssemblyAI • Chicago (IL)

On-site
USD 190,000 - 225,000
Senior AI Platform Engineer — API & Inference
Senior AI Platform Engineer — API & Inference

AssemblyAI • Washington

On-site
USD 190,000 - 225,000
Senior ML Infra & API Engineer - High-Impact Ownership
Senior ML Infra & API Engineer - High-Impact Ownership

AssemblyAI • United States

Remote
USD 190,000 - 225,000
Applied AI Engineer - Build Production-Grade AI Systems
Applied AI Engineer - Build Production-Grade AI Systems

ActAI • United States

On-site
USD 140,000 - 210,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Assured • New York (NY)

On-site
USD 140,000 - 180,000
Office in New York City
Stock options
Health and dental coverage
+2
Backend AI Engineer: Scalable Inference & Orchestration
Backend AI Engineer: Scalable Inference & Orchestration

re-zoo-me • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000
Production AI Engineer for Enterprise AI Systems
Production AI Engineer for Enterprise AI Systems

AKIVA AI, LLC • Northern (KY)

Hybrid
USD 110,000 - 190,000
Medical Insurance
Vision Insurance
PTO
+4
Senior Software Engineer, Inference
Senior Software Engineer, Inference

AssemblyAI • New York (NY)

On-site
USD 190,000 - 225,000
AI Platform Engineer: Scalable ML Infra & Production
AI Platform Engineer: Scalable ML Infra & Production

ActAI • United States

On-site
USD 150,000 - 190,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

AfterQuery • San Francisco (CA)

On-site
USD 180,000 - 240,000