Senior Data Engineer, Analytical Data Platform, Inteligent Platforms (all gender

Meyandy LLC; Berlin; Hybrid; EUR 95.000 - 135.000; Vollzeit

Benefits dieser Stelle

HelloFresh pension scheme

Box discounts

Corporate benefits

Zusammenfassung

HelloFresh is seeking a Senior Data Platform Engineer to own and evolve the data platform that powers forecasting, demand planning, and personalized experiences for millions. You will drive migration to Databricks Unity Catalog, manage a Kubernetes-based compute layer, and define patterns to enable teams to build and run data workloads reliably and cost-efficiently.

Strong Python and Terraform skills, plus Databricks and Spark expertise, are essential.

Qualifikationen

• Strong Python and Terraform skills; SQL knowledge is a plus.
• Hands-on Databricks experience; Unity Catalog is a strong plus.
• Deep familiarity with Spark and distributed compute.
• Experience orchestrating workflows with Airflow in production environments.

Aufgaben

• Lead our Databricks Unity Catalog migration—governance, lineage and access control built in.
• Own our Kubernetes-based compute platform for Spark and Airflow jobs.
• Build and maintain infrastructure-as-code with Terraform modules and GitHub Actions pipelines.
• Ensure platform reliability and observability; improve automation and reduce manual tasks.
• Collaborate with data engineering and analytics teams to facilitate downstream work.

Kenntnisse

Python

Terraform

Databricks

Spark

Airflow

AWS

Kubernetes

SQL

Tools

GitHub Actions

Terraform Modules

CI/CD

Jobbeschreibung

About the role

At HelloFresh, data is at the heart of everything we do — from the moment a customer places an order to the way we forecast demand, optimize our supply chain, and personalize experiences for millions of people. Making that data fast, reliable, and available is what our Data Platform makes possible.

We are looking for a Senior Data Platform Engineer to join our Data Platform team of 7 — the squad responsible for the infrastructure that powers our entire data ecosystem. You'll own the compute, orchestration, and storage systems that data and analytics teams depend on every day, and lead the evolution of our platform toward a more governed, scalable, and cloud-native architecture.

This is a hands‑on engineering role at the core of our platform. You'll drive our migration to Databricks Unity Catalog and Terraform-managed workspaces, sunset legacy systems, and help define the patterns that make it easy for teams across the company to build and run data workloads reliably and cost-efficiently.

What you'll do

• Lead our Databricks Unity Catalog migration. Own the transition from legacy Databricks workspaces to Unity Catalog and Terraformenabled workspaces — ensuring governance, lineage, and access control are built into the platform from the start.
• Own our Kubernetesbased compute platform. Manage the Kubernetes infrastructure that provides compute for Spark and Airflow jobs, keeping it reliable, efficient, and easy to build on.
• Build and maintain infrastructureascode. Own our Terraform modules and GitHub Actions pipelines, and set the standard for how infrastructure is provisioned and managed across the platform.
• Ensure platform reliability and observability. Keep critical data paths highly available, improve operational maturity, and invest in automation so the platform runs with minimal manual intervention.
• Collaborate across the data org. Partner with data engineering and analytics teams to ensure clean handover points and that platform changes enable rather than block downstream work.

What you'll bring

• Strong Python and Terraform skills, with a track record of building and operating production data infrastructure SQL knowledge is a plus
• Hands‑on experience with Databricks — Unity Catalog experience is a strong plus.
• Deep familiarity with Spark and distributed compute.
• Experience orchestrating workflows with Airflow in production environments.
• Proficiency with AWS infrastructure.
• Experience managing Kubernetes clusters for data workloads.
• A strong ownership mindset — you care about reliability, efficiency, and the developer experience of the teams you serve.

Nice to have

• Experience with Snowflake and large‑scale data migrations.
• Familiarity with data lakehouse architectures.
• Prior experience contributing to internal developer platforms.

What we offer

Compensation & Financial Wellbeing

• You’ll receive a competitive salary package, including a HelloFresh-subsidized pension scheme.
• Enjoy savings on your weekly HelloFresh box.
• Save with discount schemes with corporate benefits and Vorteile.

Health & Wellbeing

• Support your mental wellbeing with access to platforms like Headspace and Spill.
• Stay active with 24/7 office gym access, a discounted Urban Sports Club membership, and other wellbeing resources.

Flexibility & Work-Life

• Balance your life with our flexible hybrid model.…