AI Inference Platform Engineer – Scalable & Reliable

Lyceum; Zürich; On-site; CHF 120,000 - 170,000; Full time

Job summary

Lyceum, based in Zürich, is building an AI inference platform that must be reliable, secure, and scalable as thousands of concurrent users come online. You will own performance, reliability, and infrastructure evolution, focusing on scalability, observability, and secure multi-tenant operation.

If you love building high‑performance systems and can own critical parts from design to production, join us in shaping Europe’s sovereign AI infrastructure.

Qualifications

• 3+ years of experience in backend, infrastructure, or systems engineering.
• Strong proficiency in Go and Python.
• Experience building or operating a model serving platform or ML platform.
• Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput.
• Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar).
• Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy.

Responsibilities

• Architect and implement scalable systems for thousands of concurrent users, including routing, load balancing, autoscaling, and GPU scheduling.
• Build monitoring, alerting, and incident response tooling to enable graceful degradation and automatic recovery.
• Profile and optimise the full inference path from ingestion to response delivery to reduce bottlenecks.
• Evaluate and integrate open-source inference frameworks and tooling to improve throughput and stability of the serving stack.

Skills

Go

Python

Backend

Model serving platform

Systems performance

Observability tooling

Tools

Kubernetes

Prometheus

Grafana

OpenTelemetry

Dynamo

vLLM

Triton

Job description

Lyceum, based in Zürich, is building an AI inference platform that must be reliable, secure, and scalable as thousands of concurrent users come online. You will own performance, reliability, and infrastructure evolution, focusing on scalability, observability, and secure multi-tenant operation.

If you love building high‑performance systems and can own critical parts from design to production, join us in shaping Europe’s sovereign AI infrastructure.