Senior AI Runtime Engineer - High-Performance Platform

Socket.dev; United States; Hybrid; USD 216,000 - 324,000; Full time

Benefits offered by this job

RSU grants

Comprehensive healthcare

Paid time off

Team onsite events

Job summary

Modular is building an AI platform to enable developers to deploy state-of-the-art models across hardware. As an AI Runtime Engineer, you will own a runtime that runs on CPU and GPU platforms, optimizing performance for diverse customer models.

Locations: candidates in the US or Canada may apply. You can work in our Los Altos, CA office or remotely from home; onboarding for new hires is conducted in person in Los Altos.

Qualifications

• 5+ years of experience working on high-performance computing systems.
• Experience in C++ programming and complex software systems.
• Experience with CPU or GPU runtime optimizations and performance analysis.
• Proficiency with profiling tools (CPU or GPU).
• Creativity and curiosity for solving complex problems with a team-oriented mindset.

Responsibilities

• Design and develop runtime and cross-stack optimizations to improve CPU and GPU efficiency.
• Port the Modular runtime stack to new hardware platforms and develop an API.
• Collaborate with compiler, kernels, serving, and models teams to achieve end-to-end performance.
• Collaborate with customer success to understand performance requirements and use cases.
• Collaborate with tooling and infrastructure teams to design automated performance analysis and benchmarking.

Skills

5+ years HPC

C++ programming

CPU/GPU runtime tuning

Profiling tools

Team collaboration

Job description

Modular is building an AI platform to enable developers to deploy state-of-the-art models across hardware. As an AI Runtime Engineer, you will own a runtime that runs on CPU and GPU platforms, optimizing performance for diverse customer models.

Locations: candidates in the US or Canada may apply. You can work in our Los Altos, CA office or remotely from home; onboarding for new hires is conducted in person in Los Altos.