AI Inference GPU Systems Engineer

Vast.ai Inc.; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Comprehensive health, dental, vision, and life insurance

401(k) with company match

Early-stage equity

Onsite meals and snacks

Fast-paced startup culture

Job summary

Vast.ai Inc. is seeking a systems/GPU engineer to develop kernels and algorithms that enhance AI model performance. The role is based on-site in San Francisco or Los Angeles, working closely with the technical founder and talented team.

Qualified candidates should possess strong skills in C++/CUDA, GPU architecture, and neural network tooling. Benefits include comprehensive insurance and early-stage equity.

Qualifications

• Expertise in systems engineering across the tech stack.
• Deep understanding of GPU architectures.
• Strong background in neural network performance and tooling.

Responsibilities

• Develop or extend parallel generic GPU libraries and kernels.
• Help design and deploy market-based resource management systems.
• Prototype and evaluate novel state-of-the-art methods/models.

Skills

GPU architectures

C++/CUDA

Python

Linux

Job description

Vast.ai Inc. is seeking a systems/GPU engineer to develop kernels and algorithms that enhance AI model performance. The role is based on-site in San Francisco or Los Angeles, working closely with the technical founder and talented team.

Qualified candidates should possess strong skills in C++/CUDA, GPU architecture, and neural network tooling. Benefits include comprehensive insurance and early-stage equity.