Campus Singapore-LPU Operator / Compiler / Performance Engineer

Zhiye

Singapore

On-site

SGD 120,000 - 180,000

Full time

15 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zhiye in Singapore is hiring a Campus Singapore-LPU Operator / Compiler / Performance Engineer to build LLM inference software for the Language Processing Unit. You will develop and optimize inference operators and compiler lowerings, focusing on performance across tensor shapes and precisions.

Your work includes profiling, code generation, and co-design with architecture and runtime teams to balance compiler scheduling, operator implementations, and hardware utilization.

Qualifications

  • PhD in CS, EE, Automation or related fields; exceptional final-year Master’s candidates welcome.

Responsibilities

  • Develop and optimize inference operators/kernels (GEMM, attention).
  • Implement lowering from tensor graphs to LPU ISA: fusion, buffers, scheduling, codegen.
  • Run microbenchmarks and profiling to identify bottlenecks and improve latency/throughput.
  • Co-design with architecture and runtime teams and add workloads to regression tests.

Skills

C/C++
Python scripting
Linux tooling
Parallelism

Education

PhD in CS/EE/Automation

Tools

LLVM
MLIR
TVM
Triton
CUDA

Job description

Campus Singapore-LPU Operator / Compiler / Performance Engineer

Build LLM inference software for the LPU (Language Processing Unit). Experience in any ONE of the following areas is sufficient: operator development, compiler development, or performance optimization.

Core Responsibilities
  • Develop and optimize inference operators/kernels such as GEMM and attention; tune tiling, data layouts, and data movement; validate correctness and performance across tensor shapes and precisions.
  • Implement and optimize lowering from tensor graphs/IR to LPU ISA: operator fusion, on-chip buffer allocation, instruction scheduling, and code generation.
  • Run microbenchmarks and end-to-end profiling to identify compute, memory-access, and synchronization bottlenecks; validate first-token latency, per-token latency, and throughput gains across input lengths and batch sizes.
  • Co-design with architecture and runtime teams, evaluate trade-offs among compiler scheduling, operator implementations, and hardware resource usage, and add key workloads to regression tests.
Requirements
  • Recent/new PhD in CS, EE, Automation, or related fields. Exceptional final-year Master’s students with strong relevant research or engineering track records are also welcome.
  • Proficient in C/C++ and Python scripting; experienced in Linux-based development and debugging.
  • Strong computer architecture fundamentals: parallelism, memory hierarchy, and data dependencies.
  • Able to independently break down problems, design reproducible experiments, and communicate technical contributions clearly.
Preferred
  • Experience with LLVM, MLIR, TVM, or Triton for compiler backends, code generation, or optimization; or low-level programming with CUDA or other accelerators.
  • LLM inference optimization experience, e.g., prefill/decode profiling, KV cache management, low-precision computation, or cross-chip communication.
What We Offer
  • Mentorship from architecture, compiler, and runtime experts.
  • End-to-end ownership of a core LPU inference operator or compiler optimization, from prototype to regression validation.
  • Access to state-of-the‑art foundation models; leverage LLM agents to accelerate R&D, generate tests, and validate results through correctness tests and benchmarks.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Inference Operator/Compiler Performance Engineer
LLM Inference Operator/Compiler Performance Engineer

Zhiye • Singapore

On-site
SGD 120,000 - 180,000
Campus Singapore-AI Hardware-Software Co-design Engineer
Campus Singapore-AI Hardware-Software Co-design Engineer

Zhiye • Singapore

On-site
SGD 90,000 - 120,000
Member of Technical Staff, Kernel Engineering
Member of Technical Staff, Kernel Engineering

Inferact • Singapore

On-site
SGD 200,000 - 400,000
Visa sponsorship
Medical coverage
Dental coverage
+2
LLM Inference Optimization Engineer (GPU)
LLM Inference Optimization Engineer (GPU)

Rakuten Asia Pte Ltd • Singapore

On-site
SGD 120,000 - 180,000
Member of Technical Staff, AMD GPU Performance Engineering
Member of Technical Staff, AMD GPU Performance Engineering

Inferact • Singapore

On-site
SGD 200,000 - 400,000
Visa sponsorship
Medical coverage
Dental coverage
+2
LLM Algorithm Engineer (Post Training)
LLM Algorithm Engineer (Post Training)

Shopee • Singapore

On-site
SGD 90,000 - 130,000
Staff ML Engineer: TPU Training & Inference Optimizer
Staff ML Engineer: TPU Training & Inference Optimizer

Google LLC • Singapore

On-site
SGD 180,000 - 320,000
Senior LLM Inference Performance Engineer
Senior LLM Inference Performance Engineer

Bitdeer Technologies Group • Singapore

On-site
SGD 120,000 - 180,000
Welfare benefits
Training and mentoring
LLM Algorithm Engineer
LLM Algorithm Engineer

Manus AI • Singapore

On-site
SGD 120,000 - 200,000
Equity & Shared success
Unlimited Manus Tokens
AI Infra Optimization Engineer Graduate (TikTok Global E-Commerce Recommendation & Search Architecture) - 2027 Start
AI Infra Optimization Engineer Graduate (TikTok Global E-Commerce Recommendation & Search Architecture) - 2027 Start

TikTok Inc. • Singapore

On-site
SGD 120,000 - 180,000
Stock options
Yoga & fitness
Flexible hours
+4