Senior Evaluation ML Engineer for Clinical AI Platform

kaiko.ai; Zürich; Hybrid; CHF 140.000 - 190.000; Vollzeit

Benefits dieser Stelle

Competitive salary

Pension plan

25 vacation days

Learning and development budget

Commuting subsidy

Team offsites

Zusammenfassung

kaiko.ai is hiring a Senior Evaluation ML Engineer to own the evaluation stack for scalable, production‑grade ML pipelines. The role emphasizes observability, reliability, and close collaboration with ML researchers and product to translate clinical requirements into dependable eval signals.

You will work from Zurich or Amsterdam, spending roughly half your time in the office, and contribute to a growing, international team developing clinical AI tools for diagnostics and care coordination.

Qualifikationen

• Excellent Python skills and strong software engineering fundamentals: testing, modular design, CI/CD, code review, and monorepo tooling.
• Proven experience building and operating ML inference services or MLOps infrastructure at scale, ideally for large language or multimodal models.
• Hands-on experience with distributed compute and GPU workloads; familiarity with Ray, CUDA toolchains, and container runtimes (Docker/Kubernetes).

Aufgaben

• Own AI factory orchestration for evaluation workloads, with Dagster as the primary orchestration layer.
• Maintain and evolve inference services powering evaluation runs, including resource management and throughput.
• Ensure the functional integrity of the eval stack through testing and validation across configurations.
• Own Eval/MLOps end-to-end: deployments, model registry, artifact versioning, rollout/rollback procedures, and observability.
• Develop towards a technical lead: set engineering direction and support other engineers.

Kenntnisse

Python

CI/CD

Monorepo tooling

Testing

Distributed compute

GPU workloads

MLOps

Evaluation services

Technical leadership

Tools

Dagster

Ray

Docker

Kubernetes

TensorRT-LLM

Triton Inference Server

vLLM

OpenAI Evals / eval frameworks

Terraform / IaC

Jobbeschreibung

kaiko.ai is hiring a Senior Evaluation ML Engineer to own the evaluation stack for scalable, production‑grade ML pipelines. The role emphasizes observability, reliability, and close collaboration with ML researchers and product to translate clinical requirements into dependable eval signals.

You will work from Zurich or Amsterdam, spending roughly half your time in the office, and contribute to a growing, international team developing clinical AI tools for diagnostics and care coordination.