Data Engineer / Databricks

AdvanceTech

Amsterdam

Hybrid

EUR 90,000 - 135,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Grundlig is building a foundational data product that consolidates and harmonises IKEA sales, payment, order and gift-card data. The Senior Data Engineer will design and operate batch, streaming and near-real-time pipelines, enforce data quality, and guide architectural decisions in a Databricks-lakehouse environment on a GCP stack.

You will collaborate with analysts, product teams and privacy/security stakeholders to deliver trusted, ready-for-consumption data and develop reusable data models

Qualifications

  • Senior-level experience designing, building and operating production data platforms and business-critical data products.
  • Strong hands-on Databricks experience including Apache Spark, Delta Lake, Unity Catalog and structured streaming.
  • Strong Python and advanced SQL skills.
  • Experience with distributed data processing and scalable batch and streaming pipelines.
  • Strong data-modelling skills and experience developing reliable, reusable production data models.
  • Experience with data-quality validation, reconciliation, monitoring and alerting.
  • Knowledge of event-driven architecture, change data capture, schema evolution and resilient error-handling patterns.
  • Experience with Git, automated testing, CI/CD and modern software-engineering practices.
  • Knowledge of data security, IAM, privacy, PII handling, metadata and data lineage.
  • Strong communication skills and ability to guide architectural decisions and mentor colleagues.
  • Experience with GCP, BigQuery, Dataflow, Pub/Sub and Cloud Storage.

Responsibilities

  • Design, build, test and operate batch, streaming and near-real-time data pipelines.
  • Ingest and harmonise sales, payment, order and gift-card data from multiple source systems.
  • Develop transformations and production data models using SQL, Python, BigQuery and dbt.
  • Apply Databricks and Spark experience to scalable processing, governance and lakehouse design decisions.
  • Implement validation, reconciliation, monitoring and automated data-quality controls.
  • Build resilient processing with error handling, recovery mechanisms and dead-letter queues.
  • Monitor data freshness, pipeline reliability, performance and service levels.
  • Protect sensitive data through secure data modelling and access controls.
  • Contribute to automated testing, CI/CD, code reviews and infrastructure automation.
  • Improve metadata, lineage, documentation and data-consumer experience.
  • Mentor colleagues and collaborate with source teams, analysts, product, privacy and security.

Skills

Databricks
Apache Spark
Delta Lake
Unity Catalog
Structured streaming
Python
SQL
Data modeling
Data quality
CI/CD
GCP basics
Databricks Workflows
Lakehouse architecture
dbt
Git

Tools

dbt
Git
Databricks Workflows
Terraform

Job description

Grundlig is a foundational customer’s data product that consolidates and harmonises sales and payment transactional data from multiple source systems. It covers the sales transaction lifecycle from the initial payment attempt through order creation and handover to the fulfilment system.

Grundlig integrates online and in-store sales, payments and gift-card transactions into a consistent and accessible source of data. It enables analysts and other data consumers to understand customer behaviour, monitor business performance and develop analytical products without spending unnecessary time finding, combining and cleaning data.

Built according to data-mesh principles, Grundlig supports domain-driven ownership and federated governance. The product focuses on data accuracy, consistency, accessibility and usability, providing trusted, ready-for-consumption data through BigQuery.

It also supports customer’s wider modernisation journey by providing harmonised sales and payment data to analytical products and business teams.

Describe the scope of the consultant’s assignment

The consultant will join the Grundlig team as a Senior Data Engineer and contribute to the design, development and operation of a foundational data product that consolidates and harmonises IKEA sales, payment, order and gift-card transactional data.

The assignment includes building reliable batch, streaming and near-real-time data pipelines; developing reusable data models; improving data quality, monitoring and resilience; and supporting the secure and accessible delivery of trusted data to analysts and other consumers.

As a senior team member, the consultant will help guide architectural decisions and strengthen engineering practices.

The consultant will bring practical Databricks and lakehouse expertise—including Apache Spark, Delta Lake, Unity Catalog and structured streaming—while working with and supporting Grundlig’s current GCP-based technology stack.

Day-to-day tasks:-

Design, build, test and operate batch, streaming and near-real-time data pipelines.

Ingest and harmonise sales, payment, order and gift-card data from multiple source systems.

Develop transformations and production data models using SQL, Python, BigQuery and dbt.

Apply Databricks and Spark experience to scalable processing, streaming, governance and lakehouse-related design decisions.

Implement validation, reconciliation, monitoring and automated data-quality controls.

Build resilient processing with error handling, recovery mechanisms and dead-letter queues.

Monitor data freshness, pipeline reliability, performance and agreed service levels.

Protect sensitive and personally identifiable information through secure data modelling and access controls.

Contribute to automated testing, CI/CD, code reviews and infrastructure automation.

Improve metadata, lineage, documentation and the experience of data consumers.

Mentor colleagues and collaborate with source teams, analysts, product colleagues, privacy specialists and security stakeholders.

Required:

Senior-level experience designing, building and operating production data platforms and business-critical data products.

Strong hands-on Databricks experience, including Apache Spark, Delta Lake, Unity Catalog, structured streaming, Databricks Workflows and lakehouse architecture.

Strong Python and advanced SQL skills.

Experience with distributed data processing and scalable batch and streaming pipelines.

Strong data-modelling skills and experience developing reliable, reusable production data models.

Experience with data-quality validation, reconciliation, monitoring and alerting.

Knowledge of event-driven architecture, change data capture, schema evolution and resilient error-handling patterns.

Experience with Git, automated testing, CI/CD and modern software-engineering practices.

Knowledge of data security, IAM, privacy, PII handling, metadata and data lineage.

Strong communication skills and the ability to guide architectural decisions, mentor colleagues and collaborate with technical and business stakeholders.

  • Experience with GCP, particularly BigQuery, Dataflow, Pub/Sub, Cloud Run and Cloud Storage.
  • Experience with dbt, Apache Beam, Terraform and GitHub Actions.
  • Experience working with sales, payments, orders or other high-volume transactional data.
  • Understanding of data-mesh principles, domain ownership and federated governance.
  • Experience in a product-oriented Agile or DevOps environment.
What 4 things from the box above are most important?

Extensive hands-on Databricks expertise, particularly Apache Spark, Delta Lake, Unity Catalog, structured streaming and lakehouse architecture.

Senior-level experience designing and operating reliable, scalable batch and streaming data pipelines for business-critical transactional data.

Strong technical leadership, including architectural decision-making, mentoring and clear collaboration with technical and business stakeholders.

4-7 years experience

START DATE – 15 November 2026

DURATION – 31 May 2027 2027 ( option to extend )

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Jr. and Sr. Data Engineer retail
Jr. and Sr. Data Engineer retail

Huxley • Amsterdam

On-site
EUR 90,000 - 135,000
null
Senior Data Engineer
Senior Data Engineer

Corecom Consulting • Randstad

On-site
EUR 90,000 - 135,000
Senior Databricks Data Engineer: Lakehouse & Streaming
Senior Databricks Data Engineer: Lakehouse & Streaming

AdvanceTech • Amsterdam

Hybrid
EUR 90,000 - 135,000
Staff Data Engineer (Databricks specialist)
Staff Data Engineer (Databricks specialist)

Jobgether • Netherlands

Remote
EUR 150,000 - 190,000
Fully remote work
Work-life balance
Continuous learning
+3
Specialist Solutions Architect - Data Engineering
Specialist Solutions Architect - Data Engineering

WinsAbove • Amsterdam

Hybrid
EUR 120,000 - 160,000
Specialist Solutions Architect - Data Engineering
Specialist Solutions Architect - Data Engineering

Neon • Amsterdam

Hybrid
EUR 120,000 - 180,000
Senior Data Engineer – Maastricht, NL
Senior Data Engineer – Maastricht, NL

RMM Consulting Group • Maastricht

Hybrid
EUR 70,000 - 100,000
Data Engineer - Databricks
Data Engineer - Databricks

UMATR • Amsterdam

On-site
EUR 96,000 - 138,000
Databricks Technical Lead
Databricks Technical Lead

G MASS Consulting • Amsterdam

On-site
EUR 110,000 - 160,000
Data Analyst SQL
Data Analyst SQL

AdvanceTech • Amsterdam

Hybrid
EUR 60,000 - 90,000