Senior AI Framework Architect — MAX Platform (Remote)

Modular Inc; Los Altos, Northern (CA, KY); Hybrid; USD 180,000 - 324,000; Full time

Benefits offered by this job

RSU grants

Competitive compensation

Team on-sites in Los Altos

Job summary

Modular Inc. is building a next‑gen AI platform and MAX framework to empower developers with scalable APIs for inference and training. You will shape core APIs, developer experience, and reference implementations while balancing performance, portability and maintainability.

Based in the US/Canada, you can work from our Los Altos, CA office or remotely. Onboarding occurs in person at Los Altos. The role blends API design, systems engineering and modern AI frameworks to ship coherent and powerful

Qualifications

• Significant experience designing and evolving developer-facing APIs (SDKs, frameworks, or platforms).
• Strong understanding of modern AI frameworks and their design tradeoffs (e.g., PyTorch, JAX, TensorFlow, vLLM, XLA/MLIR-adjacent ecosystems).
• Experience with inference and training systems (model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing).
• Proficiency in systems languages (C++, Rust, Go) and user languages (Python; Mojo familiarity is a plus).

Responsibilities

• Influence API surface design for MAX: namespaces, core abstractions, extension points, programming model, compatibility guarantees, developer experience.
• Design inference APIs for model loading, distributed inference, quantization, tokenization, batching, and deployment ergonomics.
• Design training APIs for single device to distributed execution with device placement and checkpointing.
• Create coherent Python and Mojo-adjacent surfaces with consistent naming, types, and conventions.

Skills

API design surface

AI framework knowledge

Inference systems

Training systems

Python

C++/Rust/Go

Mojo familiarity

Job description

Modular Inc. is building a next‑gen AI platform and MAX framework to empower developers with scalable APIs for inference and training. You will shape core APIs, developer experience, and reference implementations while balancing performance, portability and maintainability.

Based in the US/Canada, you can work from our Los Altos, CA office or remotely. Onboarding occurs in person at Los Altos. The role blends API design, systems engineering and modern AI frameworks to ship coherent and powerful