Senior Databricks Data Engineer: Lakehouse & Streaming

AdvanceTech

Amsterdam

Hybrid

EUR 90,000 - 135,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Grundlig is building a foundational data product that consolidates and harmonises IKEA sales, payment, order and gift-card data. The Senior Data Engineer will design and operate batch, streaming and near-real-time pipelines, enforce data quality, and guide architectural decisions in a Databricks-lakehouse environment on a GCP stack.

You will collaborate with analysts, product teams and privacy/security stakeholders to deliver trusted, ready-for-consumption data and develop reusable data models

Qualifications

  • Senior-level experience designing, building and operating production data platforms and business-critical data products.
  • Strong hands-on Databricks experience including Apache Spark, Delta Lake, Unity Catalog and structured streaming.
  • Strong Python and advanced SQL skills.
  • Experience with distributed data processing and scalable batch and streaming pipelines.
  • Strong data-modelling skills and experience developing reliable, reusable production data models.
  • Experience with data-quality validation, reconciliation, monitoring and alerting.
  • Knowledge of event-driven architecture, change data capture, schema evolution and resilient error-handling patterns.
  • Experience with Git, automated testing, CI/CD and modern software-engineering practices.
  • Knowledge of data security, IAM, privacy, PII handling, metadata and data lineage.
  • Strong communication skills and ability to guide architectural decisions and mentor colleagues.
  • Experience with GCP, BigQuery, Dataflow, Pub/Sub and Cloud Storage.

Responsibilities

  • Design, build, test and operate batch, streaming and near-real-time data pipelines.
  • Ingest and harmonise sales, payment, order and gift-card data from multiple source systems.
  • Develop transformations and production data models using SQL, Python, BigQuery and dbt.
  • Apply Databricks and Spark experience to scalable processing, governance and lakehouse design decisions.
  • Implement validation, reconciliation, monitoring and automated data-quality controls.
  • Build resilient processing with error handling, recovery mechanisms and dead-letter queues.
  • Monitor data freshness, pipeline reliability, performance and service levels.
  • Protect sensitive data through secure data modelling and access controls.
  • Contribute to automated testing, CI/CD, code reviews and infrastructure automation.
  • Improve metadata, lineage, documentation and data-consumer experience.
  • Mentor colleagues and collaborate with source teams, analysts, product, privacy and security.

Skills

Databricks
Apache Spark
Delta Lake
Unity Catalog
Structured streaming
Python
SQL
Data modeling
Data quality
CI/CD
GCP basics
Databricks Workflows
Lakehouse architecture
dbt
Git

Tools

dbt
Git
Databricks Workflows
Terraform

Job description

Grundlig is building a foundational data product that consolidates and harmonises IKEA sales, payment, order and gift-card data. The Senior Data Engineer will design and operate batch, streaming and near-real-time pipelines, enforce data quality, and guide architectural decisions in a Databricks-lakehouse environment on a GCP stack.

You will collaborate with analysts, product teams and privacy/security stakeholders to deliver trusted, ready-for-consumption data and develop reusable data models

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Lakehouse, Spark & BigQuery Lead
Senior Data Engineer: Lakehouse, Spark & BigQuery Lead

Corecom Consulting • Randstad

On-site
EUR 90,000 - 135,000
Senior Data Engineer – Lakehouse & Real-Time Pipelines
Senior Data Engineer – Lakehouse & Real-Time Pipelines

Huxley • Amsterdam

On-site
EUR 90,000 - 135,000
null
Data Engineer / Databricks
Data Engineer / Databricks

AdvanceTech • Amsterdam

Hybrid
EUR 90,000 - 135,000
Senior Data Engineer
Senior Data Engineer

Corecom Consulting • Randstad

On-site
EUR 90,000 - 135,000
Jr. and Sr. Data Engineer retail
Jr. and Sr. Data Engineer retail

Huxley • Amsterdam

On-site
EUR 90,000 - 135,000
null
Senior Databricks Data Engineer — Lakehouse & Delta Lake
Senior Databricks Data Engineer — Lakehouse & Delta Lake

UMATR • Amsterdam

On-site
EUR 96,000 - 138,000
Databricks Data Engineer: Scale Data Pipelines & Lakehouse
Databricks Data Engineer: Scale Data Pipelines & Lakehouse

Xebia Group • Amsterdam

On-site
EUR 70,000 - 110,000
Lease car or mobility budget
Laptop choice after first year
Phone
Databricks Engineer: Lakehouse & Pipelines
Databricks Engineer: Lakehouse & Pipelines

Sogeti • Utrecht

Hybrid
EUR 83,000 - 100,000
Sterk inhouse L&D-budget
Hybride of parttime opties
26 vakantiedagen en jaarlijkse bonus
Senior Software Engineer, Data Enablement & Platform
Senior Software Engineer, Data Enablement & Platform

Inter IKEA Group • Delft

On-site
EUR 90,000 - 130,000
Databricks Lakehouse Data Engineer | Remote & Growth
Databricks Lakehouse Data Engineer | Remote & Growth

Maritieme Vacaturebank • Nootdorp

Hybrid
EUR 70,000 - 95,000
Competitive salary
29 holidays per year
Training opportunities
+6