Senior AI Inference Systems Engineer

Genesis

Paris

On-site

EUR 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Genesis is seeking a senior engineer to build and optimize real-time ML inference pipelines and distributed systems for on-device deployment and GPU clusters. You will write efficient low-level code (CUDA/Triton) and integrate with high-level frameworks, ensuring reliability and rapid diagnosis of regressions across stacks.

The role demands deep expertise in Python and systems languages, plus a track record of scaling inference workloads in both throughput-focused clusters and latency-sensitive

Qualifications

  • 8+ years in distributed systems/ML infrastructure/high-performance serving
  • Production-grade Python with strong systems languages background (C++/Rust/Go)
  • Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory/compute scheduling
  • Proven track record scaling inference workloads in throughput and latency-critical environments
  • System-level mindset tuning hardware–software interactions for efficiency

Responsibilities

  • Build low-latency inference pipelines for on-device deployment
  • Design and optimize distributed inference systems on GPU clusters
  • Implement efficient low-level code (CUDA, Triton, custom kernels)
  • Optimize workloads for throughput and latency
  • Develop monitoring and debugging tools for reliability and rapid diagnosis

Skills

Distributed systems
ML infrastructure
Python
C++/Rust/Go
CUDA/Triton
Kernel optimization
Quantization
System tuning

Tools

CUDA
Triton
Kernels

Job description

Genesis is seeking a senior engineer to build and optimize real-time ML inference pipelines and distributed systems for on-device deployment and GPU clusters. You will write efficient low-level code (CUDA/Triton) and integrate with high-level frameworks, ensuring reliability and rapid diagnosis of regressions across stacks.

The role demands deep expertise in Python and systems languages, plus a track record of scaling inference workloads in both throughput-focused clusters and latency-sensitive

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Realtime On-Device & GPU Inference Architect
Realtime On-Device & GPU Inference Architect

Genesis AI • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI Training Systems Engineer
Senior AI Training Systems Engineer

Genesis • Paris

On-site
EUR 120,000 - 180,000
AI Training Systems Engineer (Distributed HPC)
AI Training Systems Engineer (Distributed HPC)

Genesis AI • Paris

On-site
EUR 90,000 - 140,000
Inference
Inference

Genesis • Paris

On-site
EUR 120,000 - 160,000
Inference
Inference

Genesis AI • Paris

Hybrid
EUR 90,000 - 150,000
Senior ML Inference Systems Engineer | Remote & Equity
Senior ML Inference Systems Engineer | Remote & Equity

Cast AI • France

Remote
EUR 90,000 - 140,000
Equity options
Remote-first
Learning budget
+4
Data Infrastructure Engineer - Petabyte-Scale AI Pipelines
Data Infrastructure Engineer - Petabyte-Scale AI Pipelines

Genesis AI • Paris

On-site
EUR 90,000 - 120,000
Senior ML Inference Engineer — Optimize Throughput (Remote)
Senior ML Inference Engineer — Optimize Throughput (Remote)

Creandum • France

Remote
EUR 107,000 - 160,000
Equity options
Remote-first global environment
Inference Systems Engineer: Scale & Performance
Inference Systems Engineer: Scale & Performance

Mistral • Paris

Hybrid
EUR 120,000 - 180,000
Healthcare coverage
Relocation support
Wellness programs
ML Systems Engineer for High-Performance AI Inference
ML Systems Engineer for High-Performance AI Inference

Arago • Paris

On-site
EUR 90,000 - 140,000
Stock options
Healthcare
Pension
+2