Paris-Based Agentic Compiler Engineer for LLM Inference

Varsity Capital; Paris; Hybrid; EUR 110,000 - 160,000; Full time

Benefits offered by this job

Work on AGCO and compiler stack

Ownership of technical decisions

Direct access to full inference stack

Fast iteration from idea to execution

Job summary

Kog in Paris is hiring engineers to build AGCO, an agentic compiler for optimizing LLM execution across GPUs. You will contribute to compiler IR design, optimization passes, lowering, verification, and performance tuning, shaping how models run efficiently in datacenters.

Join a small team where you own technical decisions, perform end-to-end experimentation on real hardware, and drive improvements from ideas through compilation, execution, and measurement, with deep focus on compilers, GPU

Qualifications

• Experience in compiler engineering, including optimization passes, IRs, lowering, code generation, LLVM, or MLIR.
• Experience with GPU programming, profiling, and hardware awareness.
• Proven ability to build and optimize LLM inference engines and related systems.

Responsibilities

• Design compiler IRs and transformations for LLM computations.
• Develop optimization passes, lowering, and code generation.
• Create search methods to explore implementations and execution strategies.
• Implement verification and correctness checks for generated changes.
• Handle GPU execution, profiling, and performance optimization.
• Ensure robust LLM inference across operators, memory and parallelism.

Skills

Compiler engineering

GPU programming

LLM inference engines

Verification

Performance optimization

Tools

CUDA

HIP

Metal

Vulkan

LLVM

MLIR

Job description

ABOUT KOG

Kog builds a co-designed inference stack for real-time AI agents on standard NVIDIA and AMD datacenter GPUs, spanning model architecture, inference engine, compilers, and low-level GPU kernels.

We developed Laneformer 2B and Delayed Tensor Parallelism (DTP), a Transformer architecture designed to overlap communication with computation.

Our inference stack generates 3,500 tokens/s per request on 8 AMD MI300X GPUs and 2,100 tokens/s per request on 8 NVIDIA H200 GPUs, in FP16 at batch size 1, without quantization or speculative decoding.

Our next challenge is making model optimization faster and more scalable. New models are released constantly, and spending months adapting each one to a specific GPU setup is not sustainable.

This is why we're developing AGCO, our agentic compiler initiative. The goal is to build on our existing optimization techniques to dramatically reduce the time needed to port and optimize models across different GPU architectures, progressively automating parts of that process.

We're a team of 10 people, including three PhD holders and one PhD candidate.

Try our technology at playground.kog.ai and read more on the Kog Labs blog.

WHAT YOU WILL WORK ON

You will help design and build AGCO, contributing to:

• Compiler and IR design, optimization passes, lowering, and code generation.

• GPU execution, kernel optimization, and performance profiling.

• Systems that explore different implementations and execution strategies.

• Verification, correctness checks, and benchmarking on real hardware.

• Optimization loops that use measured results to guide the next improvements.

We are still exploring the system's architecture. One direction combines an IR, a verifier, a compiler, and a search optimizer. You will help turn these ideas into working prototypes and determine what scales.

WHAT WE LOOK FOR

We look for engineers with strong technical expertise and original work in areas such as:

• Compiler engineering, including LLVM, MLIR, or similar technologies.

• GPU programming with CUDA, HIP, or comparable low-level tools.

• GPU performance optimization, memory, synchronization, and profiling.

• LLM inference engines, parallelism, and communication.

• Automated code generation, verification, or optimization systems.

You do not need expertise in every area. What matters is your technical depth, the systems you have personally built, and your ability to explain your design decisions and results.

We review existing technical work during the process, including code, upstream contributions, papers, theses, or technical projects.

WHAT WE OFFER

• Significant ownership over a new part of Kog's technology.

• Close collaboration with engineers working across the full inference stack.

• Direct access to NVIDIA and AMD datacenter GPUs.

• The opportunity to help build systems that change how quickly new AI models can be optimized and deployed.

Location: Paris, France. Candidates based elsewhere must be willing to relocate to Paris.