High-Performance Inference Engineer (ML Systems)

Garuda Ventures; Hermosa Beach (CA); On-site; USD 100,000 - 140,000; Full time

Job summary

Garuda Ventures is looking for engineers to bridge the gap between ML research and high-performance inference. You will work on our inference engine and model conversion toolkit, implementing new model architectures and building a wide range of features.

This role is perfect for those passionate about writing high-performance code and eager to learn. If you have experience in areas such as JAX, Rust systems programming, and benchmarking, we want to hear from you!

Qualifications

• Passion for reading ML research papers.
• High-performance code writing proficiency.
• Basic engineering skills with shipping code experience.

Responsibilities

• Work on inference engine and model conversion toolkit.
• Implement new model architectures and support new modalities.
• Write optimized kernels and build new features.

Skills

JAX / Equinox / Pallas stack

Rust systems programming

Writing Metal / Vulkan kernels

Neural codecs and voice model architectures

Trellis-based quantization approaches

Advanced speculative decoding methods

Understanding of Transformer / SSM / Diffusion / Vision language models

Benchmarking inference performance and model quality

Strong linear algebra and optimization methods

Job description

Garuda Ventures is looking for engineers to bridge the gap between ML research and high-performance inference. You will work on our inference engine and model conversion toolkit, implementing new model architectures and building a wide range of features.

This role is perfect for those passionate about writing high-performance code and eager to learn. If you have experience in areas such as JAX, Rust systems programming, and benchmarking, we want to hear from you!