Senior Software Engineer - ML Infra & Production APIs

AssemblyAI

Chicago (IL)

On-site

USD 190,000 - 225,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into reliable, scalable products. You’ll join a fast-paced team bridging research and applied engineering to expose model capabilities via robust APIs.

You will collaborate with researchers and customers to ensure latency, reliability, and usability meet production needs as the project scales, delivering value across the stack.

Qualifications

  • Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production.
  • Comfort operating with ambiguity; research timelines and product timelines don’t always align.
  • Genuine curiosity about AI/ML; you should understand models well enough to inform engineering decisions.
  • Strong collaboration skills; you'll work daily with researchers, applied engineers, and customers.

Responsibilities

  • Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and iteration.
  • Scale inference infrastructure to support our 1M+ API users.
  • Partner with researchers to productionize new techniques and improve latency, reliability, and ergonomics.
  • Work with customers and Applied teams to understand usage and feed insights back into product design and research direction.
  • Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling.

Skills

Backend engineering
ML infrastructure
APIs in production
Ambiguity tolerance
Curiosity about AI/ML
Cross-functional collaboration

Job description

AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into reliable, scalable products. You’ll join a fast-paced team bridging research and applied engineering to expose model capabilities via robust APIs.

You will collaborate with researchers and customers to ensure latency, reliability, and usability meet production needs as the project scales, delivering value across the stack.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior ML Infra & API Engineer - High-Impact Ownership
Senior ML Infra & API Engineer - High-Impact Ownership

AssemblyAI • United States

Remote
USD 190,000 - 225,000
Senior AI Infrastructure & API Engineer
Senior AI Infrastructure & API Engineer

AssemblyAI • New York (NY)

On-site
USD 190,000 - 225,000
Senior AI Platform Engineer — API & Inference
Senior AI Platform Engineer — API & Inference

AssemblyAI • Washington

On-site
USD 190,000 - 225,000
AI Platform Engineer: Scalable ML Infra & Production
AI Platform Engineer: Scalable ML Infra & Production

ActAI • United States

On-site
USD 150,000 - 190,000
Real-Time ML Infrastructure Engineer
Real-Time ML Infrastructure Engineer

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
ML Infra Engineer — Real-Time, Scalable Data Systems
ML Infra Engineer — Real-Time, Scalable Data Systems

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Senior AI Engineer - Production ML & Cloud Pipelines
Senior AI Engineer - Production ML & Cloud Pipelines

Q2 • United States

Hybrid
USD 130,000 - 170,000
Hybrid Work Opportunities
Flexible Time Off
Career Development & Mentoring Program
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Assured • New York (NY)

On-site
USD 140,000 - 180,000
Office in New York City
Stock options
Health and dental coverage
+2
ML Infra Engineer: From Research to Production
ML Infra Engineer: From Research to Production

Path Robotics • North Carolina

On-site
USD 120,000 - 180,000
Daily lunch provided
Flexible PTO
Medical, dental, vision coverage
+3
Staff AI Infrastructure Engineer – ML Platform & Edge
Staff AI Infrastructure Engineer – ML Platform & Edge

Anduril Industries • Costa Mesa (CA)

On-site
USD 220,000 - 292,000