AI Runtime Engineer - Cross-Platform Performance (Remote)

Modular, a Qualcomm company; United States; Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Amazing team

World-class benefits

Job summary

Modular, a Qualcomm company, is building the next-generation AI platform. As an AI Runtime Engineer, you will own a runtime across CPU and GPU hardware, optimizing performance for diverse AI models and deployments.

You will design cross-stack optimizations, port the runtime to new hardware, and work with multiple teams to achieve end-to-end performance. This role offers hybrid work with occasional in-person onboarding in the US.

Qualifications

• 5+ years of experience in high-performance computing systems.
• Experience with C++ programming and complex software systems.
• Experience with CPU/GPU runtime optimizations and performance analysis.
• Proficiency with one or more profiling tools.

Responsibilities

• Design and develop runtime and cross-stack optimizations to improve CPU and GPU efficiency.
• Port the Modular runtime stack to new hardware platforms and develop an API.
• Collaborate with compiler, kernels, serving and models teams to achieve state-of-the-art performance.
• Collaborate with customer success to understand performance requirements and use cases.
• Collaborate with tooling and infrastructure teams to design systems for automated performance analysis.

Skills

C++ programming

High-performance computing

Performance analysis

Team collaboration

Education

Advanced degree in CS

Tools

Profiling tools

Job description

Modular, a Qualcomm company, is building the next-generation AI platform. As an AI Runtime Engineer, you will own a runtime across CPU and GPU hardware, optimizing performance for diverse AI models and deployments.

You will design cross-stack optimizations, port the runtime to new hardware, and work with multiple teams to achieve end-to-end performance. This role offers hybrid work with occasional in-person onboarding in the US.