Principal Engineer, On-Device Inference & GPU Kernels

Opera

Wrocław

Hybrid

PLN 220,000 - 420,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Opera Göteborg is seeking a hands-on Principal Engineer to join its AI & Browser Innovation Hub in Wrocław, focusing on high-performance, on-device AI inference and GPU optimisation. You will own performance-critical components across speculative decoding, GPU kernels, quantisation and memory management, shaping solutions used by millions of Opera users.

This role blends low-level systems engineering with AI research, offering collaboration with AI leadership, opportunities to experiment with

Qualifications

  • Deep GPU programming experience in CUDA, Metal/MLX or Vulkan.
  • 2],

Responsibilities

  • Speculative decoding development and training of drafters.
  • Write, fuse and tune kernels across CUDA/Metal/Vulkan backends.
  • Design mixed-precision quantisation schemes for weights and activations.
  • Push time-to-first-token and tokens-per-second improvements.
  • Build memory hierarchies across GPU memory, RAM and storage.
  • Develop test matrices, telemetry and regression gates for stability.
  • Expose runtime hooks for research and security visibility.

Skills

GPU programming
CUDA
Metal/MLX
Vulkan compute
Speculative decoding
Quantisation
Performance optimization
Memory management

Tools

llama.cpp/ggml
MLX
vLLM
ONNX Runtime
OpenVINO

Job description

Location: Wrocław, Warsaw (Hybrid)

We're looking for a hands‑on Principal Engineer to join our AI & Browser Innovation Hub in Wrocław, focusing on high-performance, on-device AI inference and GPU optimisation. In this role, you'll work at the intersection of advanced AI research and low‑level systems engineering, developing solutions that make language models faster and more efficient on consumer hardware. Working closely with Opera's AI leadership, you'll take ownership of performance‑critical components, from speculative decoding and GPU kernels to quantisation and memory management. You'll have the opportunity to experiment with emerging techniques, solve complex engineering challenges, and contribute to AI capabilities used by millions of Opera users.

Role & Responsibilities
  • Speculative decoding. Train, tune and ship draft models for the models we run block‑diffusion drafters (DFlash2-like), semi‑autoregressive drafters with confidence‑scheduled verification (DSpark), EAGLE‑style heads and multi‑token prediction and keep pushing acceptance length up and drafting cost down on consumer hardware.
  • Kernels. Write, fuse and tune kernels for attention, quantised matmul, MoE routing, sampling and draft verification, across Metal/MLX, CUDA, Vulkan and OpenVINO.
  • Quantisation. Design mixed‑precision schemes for weights, activations and KV cache. Match formats to the hardware, from 4‑bit integer on integrated GPUs and NPUs to FP8, FP4 and microscaling formats on newer GPUs, and prove what each one costs in quality before it ships.
  • Prefill and decode. Push time‑to‑first‑token and tokens per second with flash and paged attention, efficient handling of sliding‑window and hybrid attention, chunked prefill and kernel‑level scheduling.
  • Tiered memory. Build hierarchical KV and context caching that spans GPU memory, system RAM and SSD, with prefix reuse, smart eviction and prefetching that hides I/O, so long contexts and multiple models fit on machines that shouldn't be able to hold them.
  • Making it work everywhere. Build the test matrix, performance telemetry and regression gates that catch a slow driver, a wrong numerical result or a stalled UI before users do.
  • Instrumentation. Expose hooks into the runtime, such as activations and attention, so research and security work can see inside models without giving up the speed of fused kernels.
Job Requirements
  • Deep, hands‑on GPU programming in at least one of CUDA, Metal/MLX or Vulkan compute, plus evidence that you've carried that work over to a second backend.
  • Hands‑on speculative decoding experience: you've implemented or trained drafters and understand what actually drives acceptance rate and end‑to‑end speed‑up.
  • A track record of making real inference workloads measurably faster in tokens per second, latency or memory with numbers you can explain.
  • Strong command of quantisation and its effect on model quality, including how you measure it.
  • Discipline about correctness. You validate numerics against a reference and measure quality, not just speed.
Nice to Have
  • Contributions to llama.cpp/ggml, MLX, vLLM, SGLang, ONNX Runtime, OpenVINO or similar.
  • Experience with drafter‑training frameworks or published work on speculative or parallel decoding.
  • Quantisation research or tooling: GPTQ, AWQ, k‑quants, MX formats, or quantisation‑aware fine‑tuning.
  • KV cache compression, offloading or paging at the systems level.
  • Experience with NPUs (Intel, Qualcomm, AMD, Apple Neural Engine).
What's On Offer

At Opera, you'll join a collaborative, international team with a flat structure, direct communication, and opportunities for professional growth.

  • Advanced computing resources: Access to Apple Silicon, NVIDIA (including Blackwell‑class), AMD, and Intel hardware, plus cloud GPUs for model training.
  • Technical ownership: Lead performance‑critical development of Opera's on‑device AI, working directly with AI leadership.
  • Global impact: Build AI solutions used by hundreds of millions of browser users across diverse hardware platforms.
  • Research opportunities: Contribute to open‑source projects and publish technical findings where appropriate.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Engineer, On-Device Inference & GPU Kernels
Principal Engineer, On-Device Inference & GPU Kernels

Opera • Województwo mazowieckie

On-site
PLN 200,000 - 350,000
Advanced computing resources
Technical ownership
Research opportunities
Principal Engineer: On-Device AI Inference & GPU Kernels
Principal Engineer: On-Device AI Inference & GPU Kernels

Opera • Wrocław

Hybrid
PLN 220,000 - 420,000
Principal Engineer, AI Security & Model Internals
Principal Engineer, AI Security & Model Internals

Opera Göteborg • Wrocław

Hybrid
PLN 220,000 - 260,000
Principal On-Device AI Inference & GPU Kernel Architect
Principal On-Device AI Inference & GPU Kernel Architect

Opera • Województwo mazowieckie

On-site
PLN 200,000 - 350,000
Advanced computing resources
Technical ownership
Research opportunities
AI Engineer
AI Engineer

Opera • Wrocław

Hybrid
PLN 120,000 - 180,000
Flat structure
Skill development
Frontend Developer
Frontend Developer

Opera • Wrocław

On-site
PLN 90,000 - 150,000
Frontend Developer
Frontend Developer

Opera Göteborg • Wrocław

On-site
PLN 120,000 - 180,000
Principal AI Security Engineer — Model Internals & Safe Browsing
Principal AI Security Engineer — Model Internals & Safe Browsing

Opera Göteborg • Wrocław

Hybrid
PLN 220,000 - 260,000
Research Engineer - Inference
Research Engineer - Inference

ElevenLabs • Polska

Remote
PLN 466,000 - 700,000
Innovative culture
Growth paths
Learning & development stipend
+3
Staff Engineer, OPs
Staff Engineer, OPs

Tenstorrent • Województwo pomorskie

Hybrid
PLN 300,000 - 520,000
Top locations