Senior ML Platform Engineer - Production Inference

Booking Holdings, Inc.; Amsterdam; Hybrid; EUR 130,000 - 170,000; Full time

Benefits offered by this job

Paid time off

Hybrid working

Discounts & benefits

Job summary

Booking.com is seeking a Senior Machine Learning Engineer I to design, build and operate the platform capabilities that make machine learning inference reliable and efficient at Booking.com scale.

This production-focused role involves integrating models into robust services, working with JVM-based services, Kubernetes, and multi-cloud as well as on-premise environments. You will lead end-to-end ownership and mentor others.

Qualifications

• Experience deploying and operating ML models in production across backend, infrastructure, or SRE domains.
• Proficiency in Java, Scala, JVM languages, or Python with strong backend engineering skills.
• Proven background designing distributed systems (microservices, RPC, queues, streaming, caching, batch).
• Hands-on experience managing containerized Kubernetes workloads in production.
• Experience with cloud/hybrid infrastructure, IaC, and CI/CD.
• Observability experience using SLIs, SLOs, metrics, logs, dashboards, and alerts.

Responsibilities

• Architect, build, and operate scalable, low-latency distributed ML inference services and prediction systems across online, async, and batch workloads.
• Manage production model deployments, model versioning, feature access, shadow/canary testing, and rollbacks.
• Optimize compute utilization (CPU, GPU, memory) and lead capacity planning to minimize operational costs.
• Operate multi-cloud and on-premise Kubernetes workloads with automated scaling, CI/CD, and IaC practices.
• Implement end-to-end telemetry (metrics, logs, traces, alerts), maintain SLIs/SLOs, and participate in on-call response to drive service resilience.
• Partner with ML Scientists and Engineers to productionize models, improve developer experience, and mentor junior team members.

Skills

Java

Scala

Backend engineering

Distributed systems

Kubernetes

CI/CD

Observability

ML serving

English communication

Job description

Booking.com is seeking a Senior Machine Learning Engineer I to design, build and operate the platform capabilities that make machine learning inference reliable and efficient at Booking.com scale.

This production-focused role involves integrating models into robust services, working with JVM-based services, Kubernetes, and multi-cloud as well as on-premise environments. You will lead end-to-end ownership and mentor others.