Senior ML Systems Engineer (JAX/TPU)

AssemblyAI, Inc.

Boston (MA)

On-site

USD 270,000 - 310,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AssemblyAI is seeking a Senior Research Engineer to advance large-scale distributed training, data processing, and inference. You’ll work with JAX/TPUs, improve training pipelines, and push production-ready ML systems forward across the research and infrastructure stack.

You will collaborate with researchers, infrastructure, and production engineering to ship impactful improvements, focusing on end-to-end problem solving and measurable results.

Qualifications

  • Expert-level proficiency with JAX and TPUs.
  • Measurment discipline and rigorous evaluation mindset.
  • Strong Python skills and ability to ship production-ready code.
  • Excellent communication and collaborative mindset to coordinate across teams.
  • Willingness to refactor and improve existing systems.

Responsibilities

  • Raise the team's experimental velocity and enable faster experiment launches.
  • Maintain and evolve the JAX training framework for scalable TPU runs.
  • Improve training data quality and surface issues with measurable gains.
  • Analyze production model accuracy and build evaluation harnesses.
  • Translate research prototypes into production-ready systems and modernize architectures.
  • Optimize production inference for speech language models, including quantization and decoding techniques.
  • Investigate performance bottlenecks from kernel to system level and ship fixes.
  • Collaborate with researchers, infrastructure, and production engineering to trace issues to their source.

Skills

Measurement discipline
Python skills
Strong communication
Collaborative mindset

Tools

JAX
TPUs
Flax
Optax
XLA
C++
Rust

Job description

AssemblyAI is seeking a Senior Research Engineer to advance large-scale distributed training, data processing, and inference. You’ll work with JAX/TPUs, improve training pipelines, and push production-ready ML systems forward across the research and infrastructure stack.

You will collaborate with researchers, infrastructure, and production engineering to ship impactful improvements, focusing on end-to-end problem solving and measurable results.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Engineer, Distributed DL (JAX/TPU)
Senior Research Engineer, Distributed DL (JAX/TPU)

AssemblyAI, Inc. • United States

Remote
USD 180,000 - 240,000
Senior Research Engineer: JAX/TPU Scale & Inference
Senior Research Engineer: JAX/TPU Scale & Inference

Remote • San Francisco (CA)

Remote
USD 270,000 - 310,000
Senior JAX AI Platform Engineer
Senior JAX AI Platform Engineer

NVIDIA Corporation • United States

Remote
USD 180,000 - 320,000
Senior Research Engineer
Senior Research Engineer

AssemblyAI • United States

Remote
USD 180,000 - 240,000
Staff ML Compute & TPU Infrastructure Engineer
Staff ML Compute & TPU Infrastructure Engineer

Apple, Inc. • San Francisco (CA)

On-site
USD 210,000 - 300,000
ML Infrastructure Engineer: Scale & Performance
ML Infrastructure Engineer: Scale & Performance

Physical Intelligence • San Francisco (CA)

On-site
USD 150,000 - 230,000
Staff Engineer - Distributed AI Infrastructure & Systems
Staff Engineer - Distributed AI Infrastructure & Systems

Micro1 • United States

Remote
USD 180,000 - 260,000
Senior ML Engineer: Architect Production ML at Scale
Senior ML Engineer: Architect Production ML at Scale

Jupiteraiinc • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Health, dental, vision coverage
401(k) with company match
Remote & Hybrid options
+4
ML Systems Engineer: RL & Scalable Training
ML Systems Engineer: RL & Scalable Training

Axiōma Search • San Francisco (CA), New York (NY)

On-site
USD 180,000 - 240,000
Senior ML Inference Engineer — Scale Production APIs
Senior ML Inference Engineer — Scale Production APIs

AssemblyAI, Inc. • New York (NY)

On-site
USD 190,000 - 225,000