ML Platform Engineer (all)

Sonia; Deutschland; Hybrid; EUR 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

Remote-first setup

Competitive salary

Full ownership of critical platform

Zusammenfassung

A software development company in Germany seeks an experienced ML Platform Engineer to enhance Kubernetes infrastructure for ML workloads. Responsibilities include supporting LLM inference and optimizing MLOps pipelines. The ideal candidate has strong Kubernetes and MLOps experience, with a focus on reliability and performance. This role allows for remote work or hybrid options in Berlin.

Qualifikationen

• 5+ years of experience in MLOps or SRE.
• Strong hands-on Kubernetes experience, including GitOps.
• Familiarity with LLM inference deployment.
• Experience with MLOps tools such as MLflow or Argo Workflows.
• Knowledge of GPU resource orchestration in Kubernetes environments.
• Strong observability skills with tools like VictoriaMetrics, VictoriaLogs, and Grafana.
• Experience with databases/brokers such as PostgreSQL, Redis, and RabbitMQ.
• Solid Python scripting skills.

Aufgaben

• Support and enhance our Kubernetes-based infrastructure.
• Deploy and optimize LLM inference systems.
• Design, build, and improve MLOps/DevOps pipelines.
• Manage GPU scheduling and autoscaling with Kubernetes-native tooling.
• Ensure observability and alerting across the platform.
• Operate and troubleshoot supporting infrastructure.
• Contribute to platform reliability, security, and performance through automation.

Kenntnisse

Kubernetes expertise

MLops

Scripting in Python

Cloud platform experience

Observability tools

Tools

GitOps (Flux or ArgoCD)

MLflow

Grafana

Helm

MLflow or Argo Workflows

VictoriaMetrics

VictoriaLogs

Grafana

PostgreSQL

Redis

RabbitMQ

Jobbeschreibung

Overview

Join to apply for the ML Platform Engineer (all) role at Sonia.

We’re looking for an experienced ML Platform Engineer (all) with deep Kubernetes expertise to support the infrastructure powering our AI and ML workloads. You’ll work closely with ML engineers on deploying cutting-edge LLM inference, refining observability, and automating workflows—always with reliability, scalability, and performance as guiding principles. This role can be performed remotely from anywhere in Germany or Luxembourg, or in a hybrid setup from our offices in Luxembourg or Berlin.

Responsibilities

• Support and enhance our Kubernetes-based infrastructure in cloud environments, running both ML/LLM workloads and general applications
• Deploy and optimize LLM inference systems
• Design, build, and improve MLOps/DevOps pipelines to support the entire development lifecycle
• Manage GPU scheduling and autoscaling with Kubernetes-native tooling
• Ensure observability and alerting across the platform
• Operate and troubleshoot supporting infrastructure
• Contribute to platform reliability, security, and performance through automation and best practices

Requirements

• 5+ years of experience in MLOps or SRE
• Strong hands-on Kubernetes experience, including GitOps (Flux or ArgoCD), Kustomize, Helm and production troubleshooting
• Familiarity with LLM inference deployment and optimization in Kubernetes (e.g., vLLM, LMCache, llm-d)
• Experience with MLOps supporting tools such as MLflow or Argo Workflows
• Understanding of GPU resource orchestration in Kubernetes environments
• Profound knowledge of observability tools, such as VictoriaMetrics, VictoriaLogs and Grafana
• Knowledge of database and broker administration (PostgreSQL, Redis and RabbitMQ)
• Solid scripting skills in Python
• Comfortable working with cloud platforms (OVHcloud, AWS, GCP or Azure)

Nice-to-Haves

• Experience with audio ML models or real-time inference
• Exposure to CI/CD practices tailored for ML systems
• Familiarity with Kubernetes networking, security, or performance tuning

Benefits

• Full ownership of a mission-critical platform
• A team that values curiosity, learning, and experimentation
• Remote-first setup with the option to work in our Berlin office
• Competitive salary depending on experience
• Work on AI infrastructure that directly impacts healthcare innovation

If you're passionate about web development and want to work with cutting-edge technologies, we’d love to hear from you!

Company and Contact

We’re Sonia, enabling AI-enhanced healthcare solutions that improve doctors’ workflows, patient care, and system efficiency.

Seniority level

• Associate

Employment type

• Full-time

Job function

• Information Technology

Industries

• Software Development

Referrals increase your chances of interviewing at Sonia by 2x