Senior Data Engineer: Lakehouse, Spark & BigQuery Lead

Corecom Consulting; Randstad; On-site; EUR 90,000 - 135,000; Full time

Job summary

Corecom Consulting seeks a Senior Data Engineer to join a team delivering a foundational data product aggregating sales, payments, orders and gift-card data from multiple sources on a GCP-based stack (BigQuery, dbt, Delta Lake).

You will design and operate scalable pipelines, implement data quality controls, and help shape lakehouse governance while collaborating with analysts, product teams and stakeholders.

Qualifications

• Senior-level experience designing and operating production data platforms.
• Hands-on Databricks experience with Spark, Delta Lake, Unity Catalog and structured streaming.
• Strong Python and advanced SQL skills.
• Proven ability to build scalable batch and streaming pipelines.
• Knowledge of data mesh, domain ownership and governance.

Responsibilities

• Design, build and operate scalable batch and streaming data pipelines.
• Ingest and harmonize transactional data from multiple sources.
• Develop transformations and production data models using Python, SQL, BigQuery and dbt.
• Apply Databricks and Spark expertise to lakehouse architecture.
• Improve data quality with validation, testing and monitoring.
• Mentor engineers and contribute to architectural decisions.

Skills

Databricks

Python

SQL

BigQuery

Spark

GCP

CI/CD

Data governance

Data quality

Data mesh

Tools

dbt

Terraform

GitHub Actions

Unity Catalog

Delta Lake

Job description

Corecom Consulting seeks a Senior Data Engineer to join a team delivering a foundational data product aggregating sales, payments, orders and gift-card data from multiple sources on a GCP-based stack (BigQuery, dbt, Delta Lake).

You will design and operate scalable pipelines, implement data quality controls, and help shape lakehouse governance while collaborating with analysts, product teams and stakeholders.