GPU Kernel & Runtime Engineer for AI Accelerators

OHO Group (Lithuania); San Francisco (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

OHO Group in San Francisco is seeking a GPU Software Engineer specializing in kernels and runtime to advance our high-performance AI compute platform.

You will optimize GPU kernels, bring models to new hardware, and collaborate with compiler and hardware teams to push performance and reliability across the stack.

Join a fast-growing startup with strong equity and a competitive benefits package.

Qualifications

• Proven track record in performance-sensitive GPU software.
• Strong background in C++ and GPU programming.
• Experience with AI workloads or accelerator systems preferred.

Responsibilities

• Develop and optimize GPU kernels for AI operations, including attention and matrix multiplication.
• Bring models onto new hardware and resolve performance or correctness issues.
• Improve memory access, parallel execution, scheduling and hardware utilization.
• Contribute to runtime software and integration with AI frameworks.
• Profile workloads, investigate bottlenecks and validate improvements through reproducible benchmarks.
• Work directly with compiler and hardware engineers to solve problems across the stack.

Skills

C++

CUDA

GPU programming

Performance optimization

Parallel programming

Tools

HIP

Triton

Profiling tools

Job description

OHO Group in San Francisco is seeking a GPU Software Engineer specializing in kernels and runtime to advance our high-performance AI compute platform.

You will optimize GPU kernels, bring models to new hardware, and collaborate with compiler and hardware teams to push performance and reliability across the stack.

Join a fast-growing startup with strong equity and a competitive benefits package.