Data Engineer: Harmonized Pipelines for Regulated Trials

CluePoints; Belgique; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Core data capability from the ground

Hands-on technical challenge

Opportunity to influence technology

Close collaboration with senior roles

visibility of data pipelines powering

Experience with Databricks/Snowflake

Job summary

CluePoints in Belgium is seeking a Data Engineer to build and maintain production-grade data pipelines and harmonization across studies and applications. You will work with the platform architect and AI Engineer to deliver auditable data snapshots powering consumer applications with regulatory compliance from the start.

Responsibilities include designing robust ingestion, integration, governance, and monitoring, enabling scalable data warehousing in Databricks or Snowflake, and ensuring data

Responsibilities

• Data-Layer Pipelines & Harmonization: Build and maintain production pipelines that bring data from different studies and applications into the data layer.
• Data-Layer Pipelines & Harmonization: Implement harmonization logic that reconciles studies with differing variables, including metadata-driven approaches.
• Data-Layer Pipelines & Harmonization: Produce harmonized data snapshots with clear refresh and versioning.
• Data-Layer Pipelines & Harmonization: Validate data flows against source systems and business expectations.
• Connectors & Integration: Shape and build connector approaches for common data-capture systems.
• Connectors & Integration: Support Databricks and Snowflake environments with secure, repeatable integration patterns.
• Connectors & Integration: Monitor schema changes, missing data, duplication and inconsistencies between sources.
• Connectors & Integration: Evaluate new data sources and determine the best extraction approach.
• Auditability, Quality & Compliance: Ensure snapshots support auditability, traceability and regulatory compliance.
• Auditability, Quality & Compliance: Implement data-quality controls covering completeness, accuracy, consistency, freshness.
• Auditability, Quality & Compliance: Set up monitoring and alerting for pipeline failures and schema changes.
• Auditability, Quality & Compliance: Apply testing, validation, and documentation standards in regulated settings.
• Platform Engineering & Collaboration: Contribute to architecture decisions with the platform architect.
• Platform Engineering & Collaboration: Establish version control, CI/CD and orchestration practices for the data layer.
• Platform Engineering & Collaboration: Monitor performance, resource usage and cost.
• Platform Engineering & Collaboration: Collaborate with AI Engineer to expose harmonized data to retrieval and AI components.

Skills

SQL

Python

Databricks

Snowflake

APIs

Data modelling

Git

CI/CD

Data governance

Monitoring

Tools

Delta Lake

Unity Catalog

Job description

CluePoints in Belgium is seeking a Data Engineer to build and maintain production-grade data pipelines and harmonization across studies and applications. You will work with the platform architect and AI Engineer to deliver auditable data snapshots powering consumer applications with regulatory compliance from the start.

Responsibilities include designing robust ingestion, integration, governance, and monitoring, enabling scalable data warehousing in Databricks or Snowflake, and ensuring data