Infra Engineer for AI Inference Platform (K8s, Dynamo)

Lyceum

Rüti (ZH)

On-site

CHF 130,000 - 190,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Lyceum is seeking a seasoned backend/infrastructure engineer to ensure the AI inference platform remains reliable, secure, and scalable as user demand grows. You will design systems for thousands of concurrent users, implement robust monitoring and auto-recovery, and push for performance improvements across the end-to-end inference path.

You will also evaluate and integrate open-source frameworks like Dynamo, vLLM, and Triton to enhance throughput, latency, and stability, while maintaining

Qualifications

  • 3+ years of backend, infrastructure, or systems engineering experience.
  • Strong proficiency in Go and Python.
  • Experience building or operating a model serving platform or ML platform.
  • Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput.
  • Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar).
  • Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenant.

Responsibilities

  • Make Lyceum's AI inference platform reliable, secure, and scalable under heavy load.
  • Architect and implement scalable systems for thousands of concurrent users with proper routing, load balancing, and autoscaling.
  • Build robust monitoring, alerting, and incident response tooling and enable graceful degradation.
  • Profile and optimise the full inference path from request ingestion to response delivery to reduce latency and improve throughput.
  • Evaluate open-source inference frameworks and tooling to improve serving stack performance and stability.

Skills

Go
Python
Model serving platform
Systems performance optimization
Observability
Security fundamentals
On-call / incident response

Tools

Prometheus
Grafana
OpenTelemetry
Kubernetes
NVIDIA Dynamo
vLLM
Triton
TensorRT-LLM

Job description

Lyceum is seeking a seasoned backend/infrastructure engineer to ensure the AI inference platform remains reliable, secure, and scalable as user demand grows. You will design systems for thousands of concurrent users, implement robust monitoring and auto-recovery, and push for performance improvements across the end-to-end inference path.

You will also evaluate and integrate open-source frameworks like Dynamo, vLLM, and Triton to enhance throughput, latency, and stability, while maintaining

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Infra Engineer: AI Inference & Kubernetes
Infra Engineer: AI Inference & Kubernetes

Lyceum • Zürich

On-site
CHF 150,000 - 190,000
Staff Backend Engineer - AI Inference Platform
Staff Backend Engineer - AI Inference Platform

Lyceum • Rüti (ZH)

On-site
CHF 130,000 - 180,000
Senior AI Inference Platform Engineer
Senior AI Inference Platform Engineer

Lyceum • Zürich

On-site
CHF 120,000 - 200,000
Member of Technical Staff – Infra, k8s, Dynamo
Member of Technical Staff – Infra, k8s, Dynamo

Lyceum • Rüti (ZH)

On-site
CHF 130,000 - 190,000
Member of Technical Staff – AI Inference platform, robustness
Member of Technical Staff – AI Inference platform, robustness

Lyceum • Zürich

On-site
CHF 120,000 - 200,000
Member of Technical Staff – Infra, k8s, Dynamo
Member of Technical Staff – Infra, k8s, Dynamo

Lyceum • Zürich

On-site
CHF 150,000 - 190,000
Platform Engineer: AI Inference & Developer Experience
Platform Engineer: AI Inference & Developer Experience

Lyceum • Zürich

On-site
CHF 100,000 - 170,000
Staff Observability Engineer — GPU Infra
Staff Observability Engineer — GPU Infra

Lyceum • Zürich

On-site
CHF 120,000 - 190,000
Backend Engineer, AI Systems
Backend Engineer, AI Systems

Actcareers • Zürich

On-site
CHF 110,000 - 170,000
Member of Technical Staff – API, Frontend, Interface, Integrations
Member of Technical Staff – API, Frontend, Interface, Integrations

Lyceum • Zürich

On-site
CHF 100,000 - 170,000
Top locations