Infra Engineer: AI Inference & Kubernetes

Lyceum

Zürich

On-site

CHF 150,000 - 190,000

Full time

41 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Lyceum is building an AI inference platform and seeks an engineer to ensure reliability, security, and scalability as user demand grows. You will focus on keeping the platform up under pressure, preventing outages, and delivering faster responses through careful design and optimization.

Your work includes scalable routing and resource scheduling, robust monitoring, and integrating open-source inference frameworks to improve throughput and latency across GPU clusters.

Qualifications

  • 3+ years of backend, infrastructure, or systems engineering experience.
  • Proficiency in Go and Python.
  • Experience building or operating a model serving platform or ML platform.
  • Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput.
  • Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar).
  • Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy.

Responsibilities

  • Architect and implement scalable systems for thousands of concurrent users.
  • Ensure reliability with graceful degradation and automatic recovery.
  • Profile and optimise the full inference path from request to response.
  • Evaluate and integrate open-source inference frameworks and tooling.

Skills

Go
Python
Model serving
Performance profiling
Observability
Security fundamentals

Tools

Prometheus
Grafana
OpenTelemetry

Job description

Lyceum is building an AI inference platform and seeks an engineer to ensure reliability, security, and scalability as user demand grows. You will focus on keeping the platform up under pressure, preventing outages, and delivering faster responses through careful design and optimization.

Your work includes scalable routing and resource scheduling, robust monitoring, and integrating open-source inference frameworks to improve throughput and latency across GPU clusters.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Inference Platform Engineer
Senior AI Inference Platform Engineer

Lyceum • Zürich

On-site
CHF 120,000 - 200,000
Staff Observability Engineer — GPU Infra
Staff Observability Engineer — GPU Infra

Lyceum • Zürich

On-site
CHF 120,000 - 190,000
Member of Technical Staff – AI Inference platform, robustness
Member of Technical Staff – AI Inference platform, robustness

Lyceum • Zürich

On-site
CHF 120,000 - 200,000
Platform Engineer: AI Inference & Developer Experience
Platform Engineer: AI Inference & Developer Experience

Lyceum • Zürich

On-site
CHF 100,000 - 170,000
Senior AI Inference & HPC Systems Engineer
Senior AI Inference & HPC Systems Engineer

NVIDIA Corporation • Switzerland

On-site
CHF 120,000 - 180,000
GPU Infra Platform Engineer: Provisioning, Isolation & Uptime
GPU Infra Platform Engineer: Provisioning, Isolation & Uptime

Lyceum • Zürich

On-site
CHF 120,000 - 170,000
Member of Technical Staff – Infra, k8s, Dynamo
Member of Technical Staff – Infra, k8s, Dynamo

Lyceum • Zürich

On-site
CHF 150,000 - 190,000
Senior AI Inference Engineer (HPC)
Senior AI Inference Engineer (HPC)

NVIDIA Corporation • Zürich

On-site
CHF 180,000 - 240,000
Senior AI Inference & HPC Systems Engineer
Senior AI Inference & HPC Systems Engineer

NVIDIA Corporation • Zürich

On-site
CHF 190,000 - 260,000
Member of Technical Staff – Monitoring
Member of Technical Staff – Monitoring

Lyceum • Zürich

On-site
CHF 120,000 - 190,000
Top locations