Staff Engineer, Hardware Enablement

Modular, a Qualcomm company

United States

Remote

USD 180,000 - 270,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Modular, a Qualcomm company, seeks a Staff Hardware Enablement Engineer to bring up and optimize support for new accelerator platforms across the software stack. You will work with Mojo kernels, compilers, and model serving, collaborating with Modular and hardware partners to deliver reliable performance.

You will learn accelerator architectures, understand ISA details, and contribute to portability and testing pipelines, while helping shape hardware portability across the stack.

Qualifications

  • Experience in high-performance computing or accelerator software.
  • Strong understanding of hardware-software interaction and performance.
  • Ability to read architecture manuals, ISA documentation, and vendor materials.

Responsibilities

  • Bring up and validate support for new hardware architectures across the Modular software stack.
  • Write, port, and optimize Mojo kernels for novel accelerator architectures.
  • Investigate performance and correctness issues across stack layers (kernel, memory, compiler, graph, vendor runtimes).
  • Develop understanding of new hardware platforms, including ISA and memory hierarchy.
  • Map AI operators and workloads to target architectures for efficient execution.
  • Contribute to portability infrastructure, tooling, and debugging workflows.
  • Collaborate with hardware vendor engineers for integration tests and issues.
  • Benchmark and profile workloads as support matures for production-quality performance.
  • Share knowledge via documentation, demos, and engineering write-ups.
  • Participate in onsites and hackathons, contributing to open engineering culture.

Skills

C++ skills
CUDA
OpenCL
GPU kernels
Communication
Vendor collaboration

Education

Bachelor's degree (Engineering/CS)
Master's degree (Engineering/CS)
PhD (Engineering/CS)

Tools

CUDA toolkit
LLVM

Job description

About Modular

At Modular, a Qualcomm company, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.

About Modular

At Modular, a Qualcomm company, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges. If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.

About The Role

We're looking for a motivated Staff Hardware Enablement Engineer to help bring that vision to new accelerator platforms. You'll work across the Modular software stack — from Mojo kernels and compiler infrastructure to the graph compiler, runtime, and MAX model serving — to bring up and optimize support for new hardware architectures. This is a highly cross-functional systems role. You'll learn how new accelerators execute computation, move data, synchronize work, and interact with vendor toolchains, then help translate those capabilities into a performant and reliable experience within Modular's stack. You'll collaborate closely with engineers across Modular as well as external hardware partners, developing deep expertise in novel architectures while contributing directly to our hardware portability story.

LOCATION

Candidates based in the US, Canada, and UK are welcome to apply. You can work in our office in Los Altos, CA, Edinburgh, or remotely from home. Onboarding for new hires is conducted in-person at the appropriate office.

What You Will Do
  • Bring up and validate support for new hardware architectures across the Modular software stack, working across kernels, compiler infrastructure, runtime, graph execution, and model serving.
  • Write, port, and optimize Mojo kernels for novel accelerator architectures, establishing correctness first and iterating toward strong performance.
  • Investigate performance and correctness issues across layers of the stack, including kernel execution, memory movement, compiler lowering, graph decisions, synchronization, and vendor runtime behavior.
  • Develop a detailed understanding of new hardware platforms, including their ISA, execution model, memory hierarchy, synchronization mechanisms, compiler constraints, and vendor toolchains.
  • Help map important AI operators and workloads onto new architectures, understanding how operations such as matrix multiplication, convolution, reductions, and other model primitives execute efficiently on the target hardware.
  • Contribute to portability infrastructure, compiler integration, tooling, testing, and debugging workflows that make it easier to support additional hardware platforms over time.
  • Collaborate directly with hardware vendor engineers to understand platform capabilities, investigate issues, build integration tests, and improve end-to-end hardware/software integration.
  • Benchmark and profile workloads as hardware support matures, identifying bottlenecks and helping move new platforms from initial correctness toward production-quality performance.
  • Share knowledge about emerging architectures with the broader team through technical documentation, demos, design discussions, and engineering write-ups.
  • Participate in company events such as onsites and hackathons while contributing to Modular's collaborative and open engineering culture.
What You Bring To The Table
  • 5+ years of experience in high-performance computing, compiler engineering, accelerator software, systems engineering, or a closely related domain in industry or research.
  • Strong C++ skills and experience contributing to complex, multi-component software systems.
  • Hands‑on experience with at least one heterogeneous programming model such as CUDA, SYCL, OpenCL, or a comparable accelerator programming environment.
  • Understanding of how AI operators are implemented at a low level, demonstrated through experience writing or modifying GPU kernels, custom operators, accelerator code, or working with ML frameworks such as PyTorch at the C++/systems layer.
  • Working knowledge of hardware concepts such as memory hierarchy, parallel execution, synchronization, data movement, and the relationship between software performance and the underlying architecture.
  • Experience debugging problems that cross software abstraction boundaries and an ability to systematically reason about correctness and performance.
  • Ability and enthusiasm to learn unfamiliar hardware platforms quickly, including becoming comfortable reading architecture manuals, ISA documentation, and vendor technical materials.
  • Strong communication and collaboration skills, including the ability to work effectively across compiler, runtime, kernel, and hardware teams.
  • A pragmatic engineering mindset that prioritizes correctness during initial bringup while understanding how to iterate methodically toward performance.
Minimum Qualifications
  • Bachelor's degree in Engineering, Information Systems, Computer Engineering, Electrical Engineering, Computer Science, or related field and 4+ years of Software Engineering or related work experience. OR
  • Master's degree in Engineering, Information Systems, Computer Engineering, Electrical Engineering, Computer Science, or related field and 3+ years of Software Engineering or related work experience. OR
  • PhD in Engineering, Information Systems, Computer Engineering, Electrical Engineering, Computer Science, or related field and 2+ years of Software Engineering or related work experience. AND
  • 2+ years of work experience with Programming Language such as Python, Mojo, Rust, C++, etc.
Helpful, But Not Required
  • Experience with non-GPU accelerator architectures, such as DSPs, NPUs, AI ASICs, or other specialized compute hardware.
  • Familiarity with MLIR or LLVM compiler infrastructure.
  • Experience with GPU DSLs or libraries such as Triton, CUTLASS, or CuTe.
  • Previous experience bringing up software support for a new accelerator or hardware platform.
  • Experience working directly with hardware vendors or silicon engineering teams.
  • Experience profiling and optimizing kernels or accelerator workloads using hardware‑specific performance tools.
  • Exposure to graph compilers and understanding how model operations are lowered, scheduled, fused, or mapped onto target hardware.
  • Experience with model serving or inference optimization workflows.
  • Familiarity with runtime concepts such as device management, memory allocation, queues, synchronization, or asynchronous execution.
  • Experience working on portability layers that target multiple hardware architectures.
What Modular Brings To The Table
  • Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
  • World‑class Benefits. In order to attract the best, we need to offer the best. Your benefits package may include comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities. Please note that specific benefit packages may vary based on your location, you can read more about benefits offered by Qualcomm here.
  • Competitive Compensation. We offer very strong compensation packages, including RSU grants. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
  • Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.

Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and share a purpose to fundamentally change how software is built for AI and accelerated computing.

The estimated base salary range for this role to be performed in the US, regardless of the state, is $180,000.00 - $270,000.00 USD.

The estimated base salary range for this role to be performed in Canada, regardless of the province, is $172,400.00–$258,600.00 CAD.

The estimated base salary range for this role to be performed in the United Kingdom is £99,600.00 – £150,000.00 GBR.

The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job‑related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. Total compensation may also include annual target bonus, equity, and benefits, as applicable.

For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have upcoming openings at lower or higher levels than the one advertised.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Manager, Hardware Bringup
Senior Staff Manager, Hardware Bringup

Modular, a Qualcomm company • United States

Remote
USD 223,000 - 334,000
RSU grants
Healthcare coverage
Retirement plan
+2
Principal Mojo Libraries Engineer
Principal Mojo Libraries Engineer

Modular, a Qualcomm company • United States

Hybrid
USD 148,000 - 270,000
Healthcare coverage
Retirement plans
RSU grants
+5
Technical Program Manager, Hardware Alliance Los Altos, CA · Hybrid
Technical Program Manager, Hardware Alliance Los Altos, CA · Hybrid

Modular Inc • Los Altos (CA)

Hybrid
USD 202,000 - 303,000
Team onsite events in Los Altos
Competitive compensation with RSU
Technical Program Manager, Hardware Alliance
Technical Program Manager, Hardware Alliance

Modular, a Qualcomm company • Los Altos (CA)

Hybrid
USD 202,000 - 303,000
Comprehensive healthcare
RSU grants
Travel opportunities
+1
Technical Program Manager, Cloud Inference
Technical Program Manager, Cloud Inference

Modular, a Qualcomm company • United States

Hybrid
USD 143,000 - 277,000
RSU grants
Competitive compensation
Team onsite events
Technical Community Manager
Technical Community Manager

Modular, a Qualcomm company • United States

Hybrid
USD 124,000 - 233,000
Healthcare coverage
Retirement and savings programs
RSU grants
+4
Staff Mojo Compiler Engineer
Staff Mojo Compiler Engineer

Modular, a Qualcomm company • United States

Hybrid
USD 216,000 - 372,000
RSU grants
Team onsite events
Excellent benefits
Technical Product Marketing Manager
Technical Product Marketing Manager

Modular, a Qualcomm company • United States

Hybrid
USD 158,000 - 236,000
RSU grants
Team onsites 2-4x per year
Competitive compensation
Senior Technical Community Manager United States / Canada · Remote
Senior Technical Community Manager United States / Canada · Remote

Modular Inc • Los Altos (CA)

Hybrid
USD 124,000 - 233,000
RSU grants
World-class benefits
Competitive compensation including, at
Platform Engineer, Workplace Engineering
Platform Engineer, Workplace Engineering

Modular, a Qualcomm company • Los Altos (CA)

Hybrid
USD 148,000 - 270,000
Healthcare coverage
Retirement and savings programs
Employee stock purchase opportunities
+2