AI Library Architect for MAX Framework

Modular; United States; Hybrid; USD 198,000 - 319,000; Full time

Benefits offered by this job

Premier insurance plans

401k matching

Flexible paid time off

Stock options

Job summary

Modular is seeking an AI Library Architect for MAX to own core APIs and developer experience for inference and training of AI models. You will work at the intersection of API design, systems engineering, and modern AI frameworks, shaping a coherent programming model across Python and Mojo-adjacent surfaces and driving RFCs and specs.

Based in the US or Canada, you can work in our Los Altos, CA office or remotely from home. Onboarding for new hires is conducted in-person in Los Altos, CA.

Qualifications

• Significant experience designing developer-facing APIs (SDKs, frameworks, or platforms).
• Fluency in systems languages (C++, Rust, Go) and Python; Mojo familiarity a plus.
• Experience with inference and training systems, including model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing.

Responsibilities

• Influence the design of the API surface for MAX: namespaces, core abstractions, extension points, programming model, compatibility guarantees and developer experience.
• Design inference APIs for real-world serving needs: model loading, distributed inference, quantization, tokenization/pipelines, configuration surfaces, batching/streaming, deployment ergonomics.
• Design training APIs that scale from single device to distributed execution with device placement, parallelism, checkpointing, and observability.
• Create a coherent programming model across Python and Mojo-adjacent surfaces: align naming, types, and conventions; avoid leaky abstractions; define the 'pit of success'.
• Drive RFCs and technical specs: write and socialize proposals; gather feedback; iterate towards consensus.
• Partner cross-functionally with compiler/runtime, kernels, cloud/serving, and documentation/DevRel teams to map APIs to underlying capabilities.
• Build reference implementations and exemplar code: golden-path examples, architecture templates, best-practice patterns.
• Set quality bars for APIs: versioning policy, deprecation strategy, test strategy, and documentation requirements.

Skills

APIs design

C++

Rust

Go

Python

PyTorch

JAX

TensorFlow

Mojo

System design

Job description

Modular is seeking an AI Library Architect for MAX to own core APIs and developer experience for inference and training of AI models. You will work at the intersection of API design, systems engineering, and modern AI frameworks, shaping a coherent programming model across Python and Mojo-adjacent surfaces and driving RFCs and specs.

Based in the US or Canada, you can work in our Los Altos, CA office or remotely from home. Onboarding for new hires is conducted in-person in Los Altos, CA.