Senior ML Compiler & Model Bring-Up Engineer

General Compute

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

General Compute in San Francisco seeks a senior IC to bring up new models on our ASIC. You will own the end-to-end process from reference weights to first correct tokens, collaborating with the hardware partner to ensure correctness and performance.

You will build the agentic bringup loop, verify via diffs and parity checks, and optimize after correctness with fusion, quantization, and memory layout for production-ready models.

Qualifications

  • 5+ years in systems or ML systems, with real depth in at least one of: ML compilers, model porting/bringup, or high-performance kernels.
  • Strong on the internals of modern LLM inference: transformers, attention, KV cache, MoE routing, quantization, batching.
  • Fluent with agentic tooling and self-directed work style.
  • Comfortable inside a compiler stack — MLIR/LLVM, XLA, or a vendor graph compiler.

Responsibilities

  • Own model bringup end-to-end. Take a new architecture from reference weights to first correct tokens running on our ASIC, in days, not quarters.
  • Build the agentic bringup loop harness that compiles, runs, diffs against reference, and locates failing ops.
  • Live in the compiler space: graph capture, IR lowering, op coverage, kernel selection when a model won’t compile or numbers are off.
  • Own correctness before speed; build verification harness with layer-by-layer diffs, logit parity, end-to-end evals.
  • Then optimize: operator fusion, quantization, memory layout, batching and KV-cache behavior for our hardware.
  • Collaborate shoulder-to-shoulder with hardware partner’s compiler and runtime team to ship production-grade models.

Skills

ML systems
Model bringup
High-performance kernels
Transformers internals
KV cache
MoE routing
Quantization
Agentic tooling
Self-directed
Compiler stacks

Tools

MLIR/LLVM
XLA
CUDA
Triton
TensorRT-LLM
TVM
vLLM
TGI

Job description

General Compute in San Francisco seeks a senior IC to bring up new models on our ASIC. You will own the end-to-end process from reference weights to first correct tokens, collaborating with the hardware partner to ensure correctness and performance.

You will build the agentic bringup loop, verify via diffs and parity checks, and optimize after correctness with fusion, quantization, and memory layout for production-ready models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Frontend ML Compiler Engineer for LLMs & Hardware
Frontend ML Compiler Engineer for LLMs & Hardware

Digitailor • Palo Alto (CA)

On-site
USD 140,000 - 230,000
Senior AI/SoC Modeling Engineer - High-Impact Pre-Silicon
Senior AI/SoC Modeling Engineer - High-Impact Pre-Silicon

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 168,000 - 227,000
Senior ML Compute ASIC Integration Engineer
Senior ML Compute ASIC Integration Engineer

SPD Technology • United States

Remote
USD 150,000 - 230,000
Senior AI SoC Modeler - Drive Pre-Silicon Innovation
Senior AI SoC Modeler - Drive Pre-Silicon Innovation

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+1
Model Bring-up Engineer / ML Compiler Engineer
Model Bring-up Engineer / ML Compiler Engineer

General Compute • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior ASIC Architect: Performance & Modeling Lead
Senior ASIC Architect: Performance & Modeling Lead

Meta • Austin (TX)

On-site
USD 146,000 - 209,000
Bonus
Equity
Benefits
Senior ASIC Performance Architect & Modeling Engineer
Senior ASIC Performance Architect & Modeling Engineer

Meta • Sunnyvale (CA)

Hybrid
USD 190,000 - 240,000
Senior SoC Modeling Engineer ML Accelerators (C++/SystemC)
Senior SoC Modeling Engineer ML Accelerators (C++/SystemC)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
ASIC Performance Architect & Modeling (University Grad)
ASIC Performance Architect & Modeling (University Grad)

Meta • Austin (TX)

On-site
USD 114,000 - 172,000
Bonus
Equity
Benefits
Machine Learning Engineer (Model Bring-Up)
Machine Learning Engineer (Model Bring-Up)

Cerebras • United States

Remote
USD 140,000 - 210,000