Senior Databricks Data Engineer - Build AI‑Driven Data Lakehouse

CluePoints; Belgium; Hybrid; EUR 75,000 - 110,000; Full time

Benefits offered by this job

Health Insurance

Mobility Budget

Group Pension Plan

Meal Vouchers

Job summary

CluePoints is seeking a hands-on Senior Data Engineer to own the technical design, reliability and evolution of our Databricks data foundation. You will work with analysts to combine data engineering with production-grade rigour, focusing on Delta Lake and Unity Catalog governance.

The role emphasizes autonomy from design to deployment, with exposure to AI-enabled data workflows, cloud platforms (Azure/AWS/GCP), and CI/CD practices.

Qualifications

• 5+ years in data engineering or data-platform engineering.

Responsibilities

• Own the architecture, reliability and governance of the team's Databricks lakehouse.
• Design and operate batch and streaming ingestion pipelines from the CluePoints platform and other business systems.
• Co-develop SQL, Python and PySpark transformations with the analyst team; review and optimize for performance, scalability and cost.
• Productionize analytical and AI prototypes - adding testing, orchestration, monitoring, error handling and deployment controls.
• Build automated data-quality controls, monitoring and alerting; investigate and resolve pipeline incidents.
• Implement technical governance: naming conventions, metadata, lineage, tagging and access controls via Unity Catalog.
• Apply AI and automation across the data lifecycle - code development, documentation, metadata classification and inconsistency detection.
• Collaborate with Engineering on source-system access and with Product when Databricks insights are candidates for platform integration.

Skills

SQL

Python

PySpark

Production pipelines

Cloud platforms

Autonomy

Collaboration

Tools

Databricks

Unity Catalog

Delta Lake

Lakeflow

CI/CD

Git

Job description

CluePoints is seeking a hands-on Senior Data Engineer to own the technical design, reliability and evolution of our Databricks data foundation. You will work with analysts to combine data engineering with production-grade rigour, focusing on Delta Lake and Unity Catalog governance.

The role emphasizes autonomy from design to deployment, with exposure to AI-enabled data workflows, cloud platforms (Azure/AWS/GCP), and CI/CD practices.