Hybrid Data Platform Engineer — Spark on Kubernetes

ILIAS Solutions

Diegem

Hybrid

EUR 90,000 - 130,000

Full time

4 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

ILIAS Solutions in Diegem, Belgium is seeking a Senior Backend Engineer to own the data runtime stack in production across multiple sites. You will deploy, monitor and upgrade Spark on Kubernetes, Delta Lake on MinIO, and PostgreSQL on Kubernetes, while delivering Python and Java backends and Helm-packaged bundles for customers.

Eligibility to obtain national or NATO security clearance is required; remote work is limited to a hybrid model with 2 on-site days.

Qualifications

6+ years backend engineering in production.
3+ years on data-intensive systems.
Proficient in Python, SQL and Java.
Experience with Kubernetes, Helm and Spark workloads.
Ability to obtain national or NATO security clearance.

Responsibilities

Own data runtime in production: deploy, monitor and upgrade Spark on Kubernetes, Delta Lake on MinIO, and PostgreSQL on Kubernetes.
Build and operate Spark processing jobs end-to-end with Analytics Engineers.
Design and steward PostgreSQL for analytical and serving workloads.
Deliver Python and Java backends that feed dashboards and GenAI tools.
Package the stack as Helm charts and offline bundles for customer install.
Lead migration from Docker Swarm to RKE2 and raise observability standards.