Senior Inference Systems Engineer – Hybrid/Remote

Openkrill; United States; Hybrid; USD 148,000 - 270,000; Full time

Benefits offered by this job

Healthcare coverage

Retirement plan

RSU grants

Team events

Job summary

Modular, a Qualcomm company, is building a next-generation AI platform to radically improve how developers build and deploy AI models. We seek a senior systems programmer to unify inference features and create robust distributed abstractions for scalable AI workloads.

You will design modular interfaces, drive architecture decisions, and optimize performance across Python, Rust, Mojo, and related technologies in a fast-paced environment.

Qualifications

• 5+ years of systems programming experience with a focus on performance, concurrency, and distributed architectures.
• Strong instinct for API and abstraction design, and the ability to present a strong case for design proposals.
• Comfortable working in Python, Rust, Mojo, or similar (in the agentic‑coding era, we believe deep understanding of software systems supersedes knowing language syntax).
• Intuition and ability to reason about pathological performance bottlenecks in complex systems, and translate that into concrete diagnostics and solutions.
• Demonstrated ownership of software solutions from implementation through production support.

Responsibilities

• Leading cross-team architecture-level decisions on concurrency, data movement, and system boundaries in a fast-moving in-house software stack spanning from the metal to the cloud.
• Developing flexible and extensible interfaces for open-source model developers and community contributors.
• Designing highly modular systems with clear contracts to create components with unambiguous ownership, testability, and scaffolding for robust agentic development.

Skills

systems programming

API design

Python

Rust

Mojo

production ownership

research orientation

Tools

High-performance ML inference

Job description

Modular, a Qualcomm company, is building a next-generation AI platform to radically improve how developers build and deploy AI models. We seek a senior systems programmer to unify inference features and create robust distributed abstractions for scalable AI workloads.

You will design modular interfaces, drive architecture decisions, and optimize performance across Python, Rust, Mojo, and related technologies in a fast-paced environment.