Machine Learning Compiler Engineer

janestreet

New York (NY)

On-site

USD 260,000 - 320,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Jane Street in New York is seeking compiler engineers to join a new ML Compilers Team. You will work on ML compiler technologies to turn research ideas into scalable training jobs and low-latency inference.

You will shape the development of our compiler stack, collaborate with researchers and engineers across frameworks and GPU backends, and contribute to performance optimizations in a fast-paced trading environment.

Qualifications

  • Experience with ML compilers (Inductor, XLA, TVM) or high-level ML frameworks.
  • Solid understanding of compiler concepts and DSLs; GPU kernel experience a plus (Triton, CUDA).
  • Ability to design APIs and systems with high usability for ML workloads.

Responsibilities

  • Join a new ML Compilers Team and shape the development of Jane Street’s compiler stack.
  • Translate research ideas into high-throughput training jobs and low-latency inference.
  • Collaborate with ML/framework teams to optimize performance across hardware.

Job description

About the position

We're looking for compiler engineers to join a new ML Compilers Team at Jane Street.

Machine learning is a critical pillar of our global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.

ML compilers let us quickly turn research ideas and novel architectures into high-throughput training jobs and low-latency inference. To get the most out of our hardware resources and enable rapid model development and deployment, we are working to understand and improve the current ML compiler technologies and explore where it makes sense to build our own solutions. In this role, you would shape the development of our compiler stack.

If you've never thought about a career in finance, you're in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you'll fit right in.

About you

The ideal candidate has worked on an ML compiler in the past, but non-ML compiler experience is also valuable. Experience with any part of the stack is fine, be it high-level ML frameworks (PyTorch, Jax, TensorFlow), graph compilers (Inductor, XLA, TVM), or kernel DSLs (Triton, Helion, cuTile). You should understand how all those pieces fit together even if you are unfamiliar with specific parts.

Some other things you might be excited about are:
  • Optimizations in ML compilers: algebraic rewriting, materialize vs recompute tradeoffs and fusion, equality saturation, scheduling languages, loop-level optimization, autotuning
  • ML compiler frontends: graph capture, symbolic and dynamic shapes, control flow, automatic differentiation
  • GPU kernel programming and architecture: Triton, cuTile, CuTeDSL, CUDA, compute and memory hierarchies, programming with tensor cores
  • Compiler concepts: static analysis, intermediate representations like SSA and CFGs, instruction selection
  • ML inference: CUDA Graphs, KV caching, batching
  • ML training: Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing
  • GPU debugging and optimization: CUDA-GDB, Nsight Systems, Nsight Compute
  • Formal methods: proof assistants, automated theorem provers, agentic proof systems
  • Programming languages and DSL design: embedded DSLs, staging and metaprogramming, type systems, functional programming
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Compiler Engineer
Machine Learning Compiler Engineer

Jane Street Group • New York (NY)

On-site
USD 270,000 - 330,000
ML Compiler Engineer - Drive High-Throughput ML Stacks
ML Compiler Engineer - Drive High-Throughput ML Stacks

Jane Street Group • New York (NY)

On-site
USD 270,000 - 330,000
Intern, Compiler Engineer
Intern, Compiler Engineer

samsungsemiconductor • San Jose (CA)

On-site
USD 55,000 - 83,000
Relocation Support
Housing Stipend
Charitable giving match
ML Compiler Engineer: Build High-Throughput, Low-Latency Pipelines
ML Compiler Engineer: Build High-Throughput, Low-Latency Pipelines

janestreet • New York (NY)

On-site
USD 260,000 - 320,000
Compiler Engineer - Machine Learning Compiler
Compiler Engineer - Machine Learning Compiler

Mythic • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Competitive compensation
Equity
Benefits package
Compiler Frontend Engineer
Compiler Frontend Engineer

Digitailor • Palo Alto (CA)

On-site
USD 140,000 - 230,000
Member of Technical Staff, GPU Compiler
Member of Technical Staff, GPU Compiler

SF Tensor • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Equity
Benefits
Compiler Engineer (PyTorch / Triton / LLVM / MLIR)
Compiler Engineer (PyTorch / Triton / LLVM / MLIR)

Majestic Labs ai • Los Altos (CA)

On-site
USD 150,000 - 230,000
Member of Technical Staff, GPU Compiler
Member of Technical Staff, GPU Compiler

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Office in San Francisco
Member of Technical Staff, AI-Driven Compilation
Member of Technical Staff, AI-Driven Compilation

SF Tensor Company • San Francisco (CA)

On-site
USD 275,000 - 315,000
Relocation assistance
Equity