Senior Remote Inference Systems Engineer

Modular Inc; Los Altos (CA); Hybrid; USD 148,000 - 270,000; Full time

Benefits offered by this job

Amazing Team

World-class Benefits

Competitive Compensation

Team Building Events

Job summary

Modular, a Qualcomm company, is building the Modular platform to simplify AI model deployment and developer experience. The role focuses on unifying inference features into robust, distributed abstractions and building modular building blocks.

Located in the United States with hybrid work in Los Altos, CA; onboarding in our Los Altos office, or remote options for senior staff. Competitive compensation and strong benefits accompany this position.

Qualifications

• 5+ years of systems programming with focus on performance and distributed architectures.
• Strong API and abstraction design skills with ability to advocate design proposals.
• Proficiency in Python, Rust, Mojo or similar languages.
• Ability to diagnose bottlenecks and translate into concrete optimizations.
• Demonstrated ownership from implementation through production support.

Responsibilities

• Lead cross-team architecture-level decisions on concurrency, data movement, and system boundaries in a fast-moving in-house stack.
• Develop flexible interfaces for open-source model developers and community contributors.
• Design modular systems with clear ownership, testability, and robust scaffolding.

Job description

Modular, a Qualcomm company, is building the Modular platform to simplify AI model deployment and developer experience. The role focuses on unifying inference features into robust, distributed abstractions and building modular building blocks.

Located in the United States with hybrid work in Los Altos, CA; onboarding in our Los Altos office, or remote options for senior staff. Competitive compensation and strong benefits accompany this position.