Member of Technical Staff – Infra, k8s, Dynamo

Lyceum

Zürich

In loco

CHF 150.000 - 190.000

Tempo pieno

42 ore fa
Candidati tra i primi

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

Lyceum is building an AI inference platform and seeks an engineer to ensure reliability, security, and scalability as user demand grows. You will focus on keeping the platform up under pressure, preventing outages, and delivering faster responses through careful design and optimization.

Your work includes scalable routing and resource scheduling, robust monitoring, and integrating open-source inference frameworks to improve throughput and latency across GPU clusters.

Competenze

  • 3+ years of backend, infrastructure, or systems engineering experience.
  • Proficiency in Go and Python.
  • Experience building or operating a model serving platform or ML platform.
  • Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput.
  • Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar).
  • Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy.

Mansioni

  • Architect and implement scalable systems for thousands of concurrent users.
  • Ensure reliability with graceful degradation and automatic recovery.
  • Profile and optimise the full inference path from request to response.
  • Evaluate and integrate open-source inference frameworks and tooling.

Conoscenze

Go
Python
Model serving
Performance profiling
Observability
Security fundamentals

Strumenti

Prometheus
Grafana
OpenTelemetry

Descrizione del lavoro

Your mission

You will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.



Your focus

Scalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.


Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.


Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.


Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.



Your KPIs


  • Platform uptime and availability (SLA adherence)

  • P50/P95/P99 latency and throughput under load

  • Time-to-detection and time-to-resolution for incidents

  • Scalability milestones (concurrent users, requests per second, GPU utilisation)



Your profile

We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.



Requirements


  • 3+ years of experience in backend, infrastructure, or systems engineering

  • Strong proficiency in Go and Python

  • Experience building or operating a model serving platform or ML platform

  • Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput

  • Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar)

  • Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy



Nice to have


  • Experience with NVIDIA Dynamo or similar inference orchestration/routing frameworks

  • Hands-on experience with GPU serving infrastructure (vLLM, Triton, TensorRT-LLM)

  • Experience with Kubernetes in a production environment (deployment, networking, resource management)

  • Experience operating at scale (10k+ RPS, multi-region, multi-cluster)

  • Comfortable working on-call or in incident response when things break



Why us?


  • Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities

  • Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world

  • Ownership: Shape how European AI companies access GPU compute

  • European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Member of Technical Staff – AI Inference platform, robustness
Member of Technical Staff – AI Inference platform, robustness

Lyceum • Zürich

In loco
CHF 120.000 - 200.000
Member of Technical Staff – API, Frontend, Interface, Integrations
Member of Technical Staff – API, Frontend, Interface, Integrations

Lyceum • Zürich

In loco
CHF 100.000 - 170.000
Member of Technical Staff – Monitoring
Member of Technical Staff – Monitoring

Lyceum • Zürich

In loco
CHF 120.000 - 190.000
Member of Technical Staff – Security
Member of Technical Staff – Security

Lyceum • Zürich

In loco
CHF 120.000 - 180.000
Member of Technical Staff – Isolation, Provisioning, Uptime, Monitoring
Member of Technical Staff – Isolation, Provisioning, Uptime, Monitoring

Lyceum • Zürich

In loco
CHF 120.000 - 170.000
Member of Technical Staff – GPU Deployments
Member of Technical Staff – GPU Deployments

Lyceum • Zürich

In loco
CHF 120.000 - 180.000
Member of Technical Staff – VM Product & Infra
Member of Technical Staff – VM Product & Infra

Lyceum • Zürich

In loco
CHF 120.000 - 190.000
Member of Technical Staff – VM Product & Infra
Member of Technical Staff – VM Product & Infra

Techeurope • Zürich

In loco
CHF 110.000 - 170.000
Outstanding team
Early-stage company
Ownership of GPU compute access
GPU Platform Engineer
GPU Platform Engineer

Lyceum • Zürich

In loco
CHF 120.000 - 180.000
Member of Technical Staff – VM Features
Member of Technical Staff – VM Features

Lyceum • Zürich

In loco
CHF 120.000 - 170.000
Luoghi più richiesti