Gpu Kernel And Performance Engineer

Commonai C.I.C.

Cambourne

In loco

GBP 90.000 - 130.000

Tempo pieno

12 giorni fa

Aumenta le possibilità di ricevere una risposta da questo datore di lavoro

Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Vantaggi offerti da questo lavoro

Competitive salary
Pension
Professional development
Networking opportunities
Office near Cambridge

Descrizione del lavoro

CommonAI CIC in the Cambridge area is seeking a GPU Kernel and Performance Engineer to accelerate research models on NVIDIA GPUs. You will turn model designs into fast CUDA/Triton code and measure time/memory on real hardware.

You'll work with a small research team, optimize for memory hierarchy and participate in porting components to different accelerators. A strong grounding in GPU architecture and rigorous testing is essential.

Competenze

  • Proven experience writing and optimising GPU kernels in CUDA or Triton.
  • Strong understanding of GPU architecture and memory hierarchies (shared memory, HBM bandwidth, memory coalescing).
  • Hands-on experience profiling and optimising performance with Nsight Compute / Nsight Systems.
  • Strong Python and C/C++.
  • Rigorous testing of numerical code (mixed-precision, reference comparisons).
  • Willingness to learn new hardware architectures and programming models.

Mansioni

  • Write and optimise CUDA and Triton kernels for NVIDIA GPUs.
  • Adapt and extend open-source kernels to new models and designs.
  • Profile training and inference to identify time and memory bottlenecks.
  • Optimise for memory hierarchy and device-specific features.
  • Build tooling to measure data movement per token and validate models against hardware measurements.
  • Collaborate with training engineers to boost throughput and with researchers to test new designs.

Conoscenze

CUDA kernel programming
Triton kernel programming
GPU architecture & memory hierarchy
NVIDIA Nsight Compute / Nsight Systems
Python
C/C++
Performance profiling

Formazione

Advanced degree in CS/EE or equivalent experience

Strumenti

FlashAttention-style kernels
CUTLASS
CuTe
NCCL
NVLink

Descrizione del lavoro

CommonAI CIC is a non-profit membership organisation, founded on a belief in collaborative engineering for the safe and responsible development of foundational AI technologies. A place where AI startups, enterprises large and small, public sector bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast.

We are led by experienced founders, investors and engineers who believe that collaborative engineering drives faster AI innovation and are backed by a mix of UK Government and private funding in order to design, build and deploy innovative AI systems.

The Opportunity

We are seeking a GPU Kernel and Performance Engineer to make our research models run fast on real hardware, primarily NVIDIA GPUs. Our research team works on reducing the complexity of large language models while retaining their performance. Some of this work informs our analyses of the trade-offs between training and inference costs when scaling inference workloads. The work runs on the UK's national AI supercomputers and on our own compute nodes.

You will join a small research team and turn new model designs into efficient GPU code, then measure how much time and memory traffic they cost on real hardware. Our training runs on NVIDIA GPUs, and we also expect to work with other AI accelerators, so there is scope to learn new chips and programming models as the work develops. We care more about how well you understand hardware and memory than about ML research credentials.

What You'll Do
  • Write and optimise CUDA and Triton kernels on NVIDIA GPUs for sparse and structured model components, including block-sparse matrix operations and attention variants.
  • Adapt and extend open-source kernels, such as FlashAttention-style and block-sparse attention, to new model designs.
  • Profile training and inference to find where time and memory traffic go, using tools such as NVIDIA Nsight Systems and Nsight Compute.
  • Optimise for the GH200's memory hierarchy on Isambard-AI and for our own GPU nodes.
  • Build tools that measure data movement per generated token, and check analytic cost models against hardware measurements.
  • Test every kernel against reference implementations before it runs at scale.
  • Work with our training infrastructure engineer to raise training throughput, and with researchers to make new designs fast enough to test.
  • Evaluate how our models map onto other AI accelerators, such as TPUs and dataflow, wafer-scale and compute-in-memory architectures, and port key components to them where it is useful.
  • Contribute improvements back to open-source projects where possible.
Requirements
  • Proven experience writing and optimising GPU kernels in CUDA or Triton, ideally on recent NVIDIA architectures.
  • A strong understanding of GPU architecture and memory hierarchies (e.g. shared memory, HBM bandwidth, memory coalescing, occupancy).
  • Hands-on experience profiling and optimising performance with tools such as NVIDIA Nsight Compute or Nsight Systems.
  • Strong Python and C/C++.
  • A rigorous approach to testing numerical code (e.g. comparison against reference implementations, mixed-precision error).
  • Openness to learning new hardware architectures and programming models, often from limited documentation.
  • A strong enthusiasm for using LLMs, coding assistants, and agents as core tools in your own software development process.
We also value:
  • Experience with attention kernels (e.g. FlashAttention) or sparse kernels (e.g. block sparsity, mixture-of-experts routing).
  • Experience with NVIDIA Hopper features (e.g. TMA, warpgroup matrix instructions) or libraries such as CUTLASS and CuTe.
  • Experience with multi-GPU communication (e.g. NCCL, NVLink).
  • An understanding of LLM inference performance (e.g. KV caching, memory-bound decoding, quantisation).
  • Experience with other AI accelerators (e.g. AMD GPUs, TPUs with JAX and Pallas, or dataflow, wafer-scale and compute-in-memory architectures).
  • Experience with compiler stacks for AI hardware (e.g. MLIR, XLA, TVM).
  • A background in computer architecture, HPC, graphics or game engine programming.
  • Experience with hardware/software co-design, or with hardware performance modelling and simulation.
  • Contributions to performance-critical open-source projects (e.g. PyTorch, Triton, JAX, vLLM).
Benefits
  • A collaborative and supportive work environment
  • The opportunity to have a high impact in a growing organisation
  • Competitive salary package and pension
  • Professional development opportunities
  • Networking opportunities with influential people from across the tech sector, financial services, and academia
  • A vibrant office environment located a few minutes' walk away from Cambridge train station

CommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

GPU Kernel and Performance Engineer
GPU Kernel and Performance Engineer

CommonAI C.I.C. • Cambridge

In loco
GBP 120.000 - 170.000
Competitive salary
Pension
Professional development
+1
GPU Kernel and Performance Engineer
GPU Kernel and Performance Engineer

CommonAI Holdings Ltd • Cambridge

Ibrido
GBP 90.000 - 120.000
Competitive salary
Pension
Professional development
+2
Research Scientist (Llm Architectures)
Research Scientist (Llm Architectures)

Commonai C.I.C. • Cambourne

In loco
GBP 65.000 - 90.000
Competitive salary package
Pension
Professional development
+2
Research Scientist (LLM Architectures)
Research Scientist (LLM Architectures)

CommonAI Holdings Ltd • Cambridge

Ibrido
GBP 70.000 - 110.000
Collaborative environment
High impact work
Salary and pension
+3
Research Scientist (LLM Architectures)
Research Scientist (LLM Architectures)

CommonAI C.I.C. • Cambridge

In loco
GBP 90.000 - 130.000
Top-tier Claude Code subscription
Cambridge office near train station
Competitive salary package and pension
+1
Senior AI Systems Administrator: GPU HPC Infra Lead
Senior AI Systems Administrator: GPU HPC Infra Lead

CommonAI Holdings Ltd • Cambridge

Remoto
GBP 65.000 - 90.000
Pension
Professional development
Networking opportunities
+1
GPU Kernel & Performance Engineer — CUDA/Triton Expert
GPU Kernel & Performance Engineer — CUDA/Triton Expert

CommonAI C.I.C. • Cambridge

In loco
GBP 120.000 - 170.000
Competitive salary
Pension
Professional development
+1
Senior AI Systems Administrator: GPU & HPC Cluster Lead
Senior AI Systems Administrator: GPU & HPC Cluster Lead

CommonAI C.I.C. • Cambridge

In loco
AUD 150.000 - 190.000
Competitive salary package
Pension and benefits
Professional development
+2
AI Infrastructure Performance Engineer (Hybrid)
AI Infrastructure Performance Engineer (Hybrid)

CommonAI Holdings Ltd • Cambridge

Ibrido
GBP 70.000 - 110.000
Pension
Benefits package
Cambridge office
AI Infrastructure Performance Engineer
AI Infrastructure Performance Engineer

CommonAI C.I.C. • Cambridge

Ibrido
AUD 115.000 - 163.000
Competitive salary
Pension plan
Professional development opportunities
+2