Senior AI Inference Engineer — Kernel & Edge Optimization

Jobgether

Schweiz

Remote

EUR 137,000 - 222,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote-first team
International team
Cutting-edge AI research
Performance-critical infra
Collaboration with researchers
Edge deployment challenges

Job summary

Lever, Inc. is seeking an AI Research Engineer (Kernel & Inference Optimization) based in Switzerland. You will push the boundaries of efficient AI systems across hardware environments, balancing latency, throughput, and memory in model-serving architectures.

You will research and implement advanced inference strategies, develop custom GPU kernels, and collaborate across teams to translate research into production-ready infrastructure for edge devices.

Qualifications

  • PhD in NLP/ML with strong AI research track record and publications.
  • Proven expertise in MSL and writing custom compute shaders.
  • Experience with low-level kernel optimization on mobile/resource-constrained devices.
  • Track record delivering measurable improvements in latency, throughput and memory.
  • Deep understanding of model-serving architectures and optimization techniques.
  • Experience writing GPU kernels for mobile devices.
  • End-to-end inference pipelines from model optimization to production on constrained hardware.
  • Ability to apply empirical research and systematic experimentation to solve bottlenecks.
  • Experience benchmarking inference systems across scales and environments.
  • Knowledge of distributed inference: tensor/pipeline/expert parallelism for large GPUs.
  • Understanding diffusion models and Vision Transformers architecture.
  • Familiarity with pruning, quantization, Flash Attention, KV Cache, speculative decoding.

Responsibilities

  • Design and deploy advanced model-serving architectures for high throughput and low latency.
  • Develop inference pipelines for mobile and edge platforms with constrained resources.
  • Set performance targets for latency, throughput, memory and reliability.
  • Build controlled benchmarks and collect latency, throughput and memory metrics.
  • Create datasets and simulations to evaluate model performance in real-world conditions.
  • Identify bottlenecks and implement solutions in batching, networking and memory management.
  • Develop custom GPU kernels and compute shaders for mobile hardware (MSL).
  • Apply inference optimization techniques including pruning, quantization and Flash Attention.
  • Design distributed inference with tensor/pipeline/expert parallelism for large GPU workloads.
  • Collaborate with cross-functional teams to integrate optimized inference into production and edge apps.
  • Document results and refine optimization strategies based on empirical evidence.
  • Monitor production performance and seek improvements in scalability and efficiency.

Skills

Latency optimization
Benchmarking
Empirical research
English communication
Tensor parallelism
Distributed inference

Education

PhD in NLP or ML
CS degree

Tools

Metal Shading Language (MSL)

Job description

Lever, Inc. is seeking an AI Research Engineer (Kernel & Inference Optimization) based in Switzerland. You will push the boundaries of efficient AI systems across hardware environments, balancing latency, throughput, and memory in model-serving architectures.

You will research and implement advanced inference strategies, develop custom GPU kernels, and collaborate across teams to translate research into production-ready infrastructure for edge devices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Inference & HPC Systems Engineer
Senior AI Inference & HPC Systems Engineer

NVIDIA Corporation • Switzerland

On-site
CHF 120,000 - 180,000
AI Performance & Systems Research Scientist
AI Performance & Systems Research Scientist

Huawei Switzerland • Zürich

On-site
CHF 120,000 - 190,000
Senior AI Inference Engineer (HPC)
Senior AI Inference Engineer (HPC)

NVIDIA Corporation • Zürich

On-site
CHF 180,000 - 240,000
Hands-on AI Performance & Systems Scientist
Hands-on AI Performance & Systems Scientist

Huawei • Zürich

On-site
CHF 120,000 - 190,000
Hands-on AI research environment
Publish and open-source support
Mentor interns and collaborate with EU
Senior LLM Inference Optimization Engineer
Senior LLM Inference Optimization Engineer

FDE Times • Zürich

Hybrid
CHF 140,000 - 210,000
Competitive compensation
Career growth
Learning opportunities
+5
Senior AI Inference & HPC Systems Engineer
Senior AI Inference & HPC Systems Engineer

NVIDIA Corporation • Zürich

On-site
CHF 190,000 - 260,000
Staff ML Engineer — Real-Time Inference (Remote, CH)
Staff ML Engineer — Real-Time Inference (Remote, CH)

Inworld • Switzerland

Remote
CHF 140,000 - 210,000
Staff Machine Learning Engineer — Remote (Switzerland)
Staff Machine Learning Engineer — Remote (Switzerland)

BITKRAFT Ventures • Switzerland

Remote
CHF 150,000 - 210,000
Staff ML Engineer: Real-Time Multimodal Inference (Remote)
Staff ML Engineer: Real-Time Multimodal Inference (Remote)

Inworld AI • Switzerland

Remote
CHF 100,000 - 140,000
Research Scientist – AI Performance Optimization and Systems
Research Scientist – AI Performance Optimization and Systems

Huawei • Zürich

On-site
CHF 120,000 - 190,000
Hands-on AI research environment
Publish and open-source support
Mentor interns and collaborate with EU
Top locations