Senior Data Engineer (Databricks)

CluePoints; Belgique; Hybride; EUR 75 000 - 110 000; Plein temps

Avantages offerts par ce poste

Health Insurance

Mobility Budget

Group Pension Plan

Meal Vouchers

Résumé du poste

CluePoints is seeking a hands-on Senior Data Engineer to own the technical design, reliability and evolution of our Databricks data foundation. You will work with analysts to combine data engineering with production-grade rigour, focusing on Delta Lake and Unity Catalog governance.

The role emphasizes autonomy from design to deployment, with exposure to AI-enabled data workflows, cloud platforms (Azure/AWS/GCP), and CI/CD practices.

Qualifications

• 5+ years in data engineering or data-platform engineering.

Responsabilités

• Own the architecture, reliability and governance of the team's Databricks lakehouse.
• Design and operate batch and streaming ingestion pipelines from the CluePoints platform and other business systems.
• Co-develop SQL, Python and PySpark transformations with the analyst team; review and optimize for performance, scalability and cost.
• Productionize analytical and AI prototypes - adding testing, orchestration, monitoring, error handling and deployment controls.
• Build automated data-quality controls, monitoring and alerting; investigate and resolve pipeline incidents.
• Implement technical governance: naming conventions, metadata, lineage, tagging and access controls via Unity Catalog.
• Apply AI and automation across the data lifecycle - code development, documentation, metadata classification and inconsistency detection.
• Collaborate with Engineering on source-system access and with Product when Databricks insights are candidates for platform integration.

Connaissances

SQL

Python

PySpark

Production pipelines

Cloud platforms

Autonomy

Collaboration

Outils

Databricks

Unity Catalog

Delta Lake

Lakeflow

CI/CD

Git

Description du poste

Job Description

At CluePoints, we're redefining how clinical trials are run. As a leading provider of Risk-Based Quality Management and Data Quality Oversight software, we use advanced statistics, artificial intelligence and machine learning to improve the quality, accuracy and integrity of clinical trial data - turning artificialintelligence into human intelligence. We're an ambitious, fast-growing technology company with a dynamic and diverse international team. Collaboration, flexibility and continuous learning are part of our DNA. Guided by our values of Care, Passion and Smart Disruption, we're united by a shared mission: to create smarter ways to run efficient clinical trials and deliver AI-powered insights that improve human outcomes worldwide.

Job Description

At CluePoints, we're redefining how clinical trials are run. As a leading provider of Risk-Based Quality Management and Data Quality Oversight software, we use advanced statistics, artificial intelligence and machine learning to improve the quality, accuracy and integrity of clinical trial data - turning artificialintelligence into human intelligence. We're an ambitious, fast-growing technology company with a dynamic and diverse international team. Collaboration, flexibility and continuous learning are part of our DNA. Guided by our values of Care, Passion and Smart Disruption, we're united by a shared mission: to create smarter ways to run efficient clinical trials and deliver AI-powered insights that improve human outcomes worldwide.

The Role

We're looking for a hands-on Senior Data Engineer to own the technical design, reliability and evolution of our Databricks data foundation. You'll work alongside Clinical Data Insights Analysts - colleagues with strong business, clinical and BI expertise who also write SQL and Python - complementing their skills with deeper engineering, automation and production-grade rigour.

Job Requirements

• 5+ years in data engineering or data-platform engineering.
• Strong hands-on Databricks experience (or comparable cloud lakehouse platform).
• Advanced SQL and strong Python / PySpark skills.
• Production-grade pipeline experience - design, build, test, deploy and maintain.
• Solid understanding of Delta Lake, medallion architecture, and OLAP/OLTP transformation.
• Experience with data governance, Unity Catalog (or equivalent), automated quality controls and CI/CD.
• At least one major cloud platform: Azure, AWS or GCP.
• Practical use of generative AI in engineering workflows, with solid critical judgement on its outputs.
• High autonomy - you take ownership from design through deployment, monitoring and maintenance.
• Collaborative by nature; comfortable working directly alongside analysts who also write code.

Nice to Have

• Lakeflow Jobs / Lakeflow Declarative Pipelines; Databricks Asset Bundles.
• Databricks AI/BI, Genie, conversational analytics or AI agent experience.
• Databricks Data Engineer certification.
• Experience in a regulated environment (clinical trials, life sciences or similar).

Tech Stack

• Delta Lake
• Unity Catalog
• Lakeflow Jobs & Declarative Pipelines
• Medallion architecture
• SQL / Python / PySpark
• Microsoft Azure
• Git / CI/CD
• Databricks Asset Bundles
• Databricks AI/BI
• Genie

Job Responsibilities

• Own the architecture, reliability and governance of the team's Databricks lakehouse (Delta Lake, medallion architecture, Unity Catalog).
• Design and operate batch and streaming ingestion pipelines from the CluePoints platform and other business systems (e.g. Zendesk).
• Co-develop SQL, Python and PySpark transformations with the analyst team; review and optimize for performance, scalability and cost.
• Productionize analytical and AI prototypes - adding testing, orchestration, monitoring, error handling and deployment controls.
• Build automated data-quality controls, monitoring and alerting; investigate and resolve pipeline incidents.
• Implement technical governance: naming conventions, metadata, lineage, tagging and access controls via Unity Catalog.
• Apply AI and automation across the data lifecycle - code development, documentation, metadata classification and inconsistency detection.
• Collaborate with Engineering on source-system access and with Product when Databricks insights are candidates for platform integration.

Job Benefits

What We Offer - Belgium

• Health Insurance through Alan (100% hospitalisation cover, 80% ambulatory and dental)
• Mobility Budget for eco-transport, housing, or car allowance (flexible 3-pillar system)
• Group Insurance Plan with 6-12% employer pension contribution based on seniority
• Meal Vouchers (€8/day) and Eco Vouchers for sustainable purchases
• A hub-based hybrid model that blends flexibility with purpose - connecting teams through collaboration, learning, and a vibrant social culture.

Equal Opportunities & GDPR Notice

CluePoints is an equal opportunities employer. We value and respect diversity in our workforce and do not tolerate discrimination based on gender, age, disability, ethnic origin, religion, sexual orientation, or any other protected ground under Belgian law. Personal data collected as part of your application will be processed in compliance with the EU GDPR and Belgian data protection legislation. You have the right to access, correct, or delete your personal data at any time by contacting [e-mail].