Senior AI Framework Engineer: MAX API Architect

Modular; United States; On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health benefits

401k match up to 5%

Tax advisory services

Home office stipend

Unlimited PTO

Job summary

Modular builds a next generation AI platform powering modern applications. Senior AI Framework Engineer for MAX will own and evolve core APIs and developer experience for inference and training of AI models.

You will design scalable inference APIs, enable distributed execution, and create coherent Python and Mojo surfaces. You will drive RFCs, collaborate with compiler/runtime, kernels, cloud, and docs teams to deliver cohesive tooling.

Qualifications

• Experience with inference and training systems (model execution graphs, compilation, runtime scheduling)
• Strong understanding of modern AI frameworks and their design tradeoffs (PyTorch, JAX, TF, vLLM, XLA/MLIR)
• Strong written communication: write specs engineers can implement without ambiguity
• Significant experience designing and evolving developer-facing APIs (SDKs, frameworks)
• High engineering standards, pragmatism, and a bias towards incremental development without sacrificing long-term design

Responsibilities

• Own and evolve core APIs and developer experience for inference and training of AI models
• Design inference APIs that support real-world serving needs (loading, distributed inference, quantization, pipelines)
• Design training APIs that scale from single device to distributed execution
• Create coherent Python and Mojo-adjacent surfaces: naming, types, conventions
• Drive RFCs and technical specs: socialize proposals, gather feedback, iterate
• Partner with compiler/runtime, kernels, cloud/serving, and docs teams
• Build reference implementations and exemplar code: golden-paths and templates
• Set quality bars for APIs: versioning, deprecation, tests, and documentation

Skills

API design

Inference systems

Distributed execution

C++

Rust

Go

Python

Mojo

Performance tuning

Documentation

Job description

Modular builds a next generation AI platform powering modern applications. Senior AI Framework Engineer for MAX will own and evolve core APIs and developer experience for inference and training of AI models.

You will design scalable inference APIs, enable distributed execution, and create coherent Python and Mojo surfaces. You will drive RFCs, collaborate with compiler/runtime, kernels, cloud, and docs teams to deliver cohesive tooling.