Principal On-Device AI Inference & GPU Kernel Architect

Opera

Województwo mazowieckie

On-site

PLN 200,000 - 350,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Advanced computing resources
Technical ownership
Research opportunities

Job summary

Opera is seeking a high-impact engineer to advance on-device AI. You will optimize speculative decoding, write and fuse kernels for attention, and push performance across Metal/MLX, CUDA, Vulkan and other backends.

Join an international team to shape memory hierarchies, quantisation schemes and regression gates, and contribute to open-source-style research while delivering real-world speed-ups on consumer hardware.

Qualifications

  • Deep GPU programming experience in CUDA, Metal/MLX or Vulkan compute.
  • Hands-on speculative decoding experience: implemented or trained drafters and know what drives rate and speed.
  • A track record of speeding up inference workloads in tokens/sec, latency or memory with measurable results.
  • Strong command of quantisation and its impact on model quality and measurement.

Responsibilities

  • Speculative decoding, training and shipping draft models.
  • Write, fuse and tune kernels for attention, quantised matmul, MoE routing and draft verification across backends.
  • Design mixed-precision schemes for weights/activations with hardware formats and cost/quality trade-offs.
  • Push time-to-first-token and tokens-per-second with efficient attention, prefill and kernel scheduling.
  • Build hierarchical KV/context caching across GPU memory, RAM and SSD with eviction and prefetching.
  • Create test matrices, telemetry and regression gates to catch slow drivers or numerical issues.
  • Expose hooks into runtime (activations/attention) for research and security while preserving speed.

Skills

GPU programming
CUDA
Metal/MLX
Vulkan compute
Speculative decoding
Performance tuning

Tools

llama.cpp/ggml
MLX
ONNX Runtime
OpenVINO
vLLM

Job description

Opera is seeking a high-impact engineer to advance on-device AI. You will optimize speculative decoding, write and fuse kernels for attention, and push performance across Metal/MLX, CUDA, Vulkan and other backends.

Join an international team to shape memory hierarchies, quantisation schemes and regression gates, and contribute to open-source-style research while delivering real-world speed-ups on consumer hardware.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Engineer: On-Device AI Inference & GPU Kernels
Principal Engineer: On-Device AI Inference & GPU Kernels

Opera • Wrocław

Hybrid
PLN 220,000 - 420,000
Principal Engineer, On-Device Inference & GPU Kernels
Principal Engineer, On-Device Inference & GPU Kernels

Opera • Wrocław

Hybrid
PLN 220,000 - 420,000
Principal Engineer, On-Device Inference & GPU Kernels
Principal Engineer, On-Device Inference & GPU Kernels

Opera • Województwo mazowieckie

On-site
PLN 200,000 - 350,000
Advanced computing resources
Technical ownership
Research opportunities
LLM Inference Frameworks Engineer (GPU Acceleration)
LLM Inference Frameworks Engineer (GPU Acceleration)

Intel Corporation • Województwo pomorskie

Hybrid
PLN 216,000 - 388,000
Stock Program
Annual and Quarterly Bonuses
Employee Pension Plan
+4
Staff ML Kernels & Runtime Engineer - High-Performance AI
Staff ML Kernels & Runtime Engineer - High-Performance AI

Graphcore • Województwo pomorskie

On-site
PLN 351,000 - 474,000
Annual leave
Medical & dental
Gym card
+1
CUDA Engineer: GPU & LLM Inference Optimization
CUDA Engineer: GPU & LLM Inference Optimization

MWDN Ltd. • Województwo mazowieckie

Remote
PLN 180,000 - 240,000
29 days PTO
10 recovery days
Free English classes
+3
Senior Software Engineer
Senior Software Engineer

Luxoft • Polska

On-site
PLN 180,000 - 260,000
Laptop
Monitor
AI Networking Engineer - High-Performance Inference
AI Networking Engineer - High-Performance Inference

NVIDIA Corporation • Polska

Hybrid
PLN 293,000 - 650,000
Generous benefits package
Competitive salaries
Compiler Engineer - Poland
Compiler Engineer - Poland

microTECH Global Limited • Poland

Hybrid
PLN 180,000 - 280,000
Senior Software Engineer (AI Systems Performance)
Senior Software Engineer (AI Systems Performance)

Luxoft • Polska

On-site
PLN 180,000 - 240,000
Top locations