Remote Compiler Engineer for High-Performance AI Inference

Hanzo AI; Stati Uniti; Remoto; USD 150.000 - 230.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote-first work

Descrizione del lavoro

Hanzo AI is seeking a Senior Compiler Engineer to accelerate neural-network inference across GPUs, TPUs, and accelerators. You will work on graph optimization, IR lowering, and code generation for high-performance runtimes.

You will optimize compiler passes, build memory-management for inference, and measure performance with micro-benchmarks, profiling throughput and cost to deliver efficient AI inference at scale.

Competenze

• Strong C++ or Rust skills and deep understanding of compiler architecture.
• Familiarity with MLIR, LLVM, or ML compilation tools such as TVM, XLA, TensorRT, or TorchDynamo.
• Understanding of GPU architecture, including tensor cores, shared memory, and warp scheduling.
• Careful approach to performance measurement, micro-benchmarks, and regression testing.

Mansioni

• Develop compiler optimizations and graph transformation passes for language-model inference.
• Use compiler intermediate representations to generate efficient machine code and kernel calls.
• Improve memory handling and inference techniques such as key-value caching, speculative decoding, and paged attention.
• Benchmark and profile performance, tracking throughput and cost.

Conoscenze

C++/Rust

Compiler architecture

IRs/optimizations

GPU architecture

Performance benchmarking

Memory optimization

KV caching

Strumenti

MLIR

LLVM

TVM

XLA

TensorRT

TorchDynamo

Descrizione del lavoro

Hanzo AI is seeking a Senior Compiler Engineer to accelerate neural-network inference across GPUs, TPUs, and accelerators. You will work on graph optimization, IR lowering, and code generation for high-performance runtimes.

You will optimize compiler passes, build memory-management for inference, and measure performance with micro-benchmarks, profiling throughput and cost to deliver efficient AI inference at scale.