A complete application in a minute
Tailored resume and cover letter, ready to send.
adesso Belgium is seeking a senior Databricks Platform Engineer for a 6-month engagement with ASAP start and remote flexibility. The role focuses on designing and building a Data Product Platform on Databricks, with emphasis on platform architecture, governance, IaC, CI/CD, security, and enabling multiple teams to create data products.
You will design Lakehouse architectures, implement pipelines, govern data, and drive best practices across the data platform.
adesso Belgium, who are we? We are an IT (start-up) provider working under the adesso umbrella with proven track record in different industries. The new Belgian entity of adesso is part of the expansion and growth strategy of the adesso group.
Start date: ASAP- Remote work
Duration: 6 months
Rate: TBD- depending on your location
For one of our international customers, we are urgently looking for a senior Databricks Platform engineer.
The role we are currently looking for is closer to a Databricks Platform Engineer than a traditional Data Engineer or BI consultant. The objective is to help design and build a Data Product Platform on Databricks, with a strong focus on platform architecture, governance, Infrastructure as Code, CI/CD, security, and enabling multiple teams to build and operate data products.
Design and implementLakehouse architectureson Databricks (medallion / bronze‑silver‑gold patterns, Delta Lake, Unity Catalog).
Build robust batch and streamingdata pipelinesusing PySpark and Spark SQL, orchestrated via Databricks Workflows / Jobs.
Model data for analytics use cases (e.g. star schema for BI, curated datasets for data science).
Ingest data from APIs, files, databases and SaaS sources into data lakes and lakehouses.
Implement clear and testable transformation logic (data quality checks, deduplication, SCD, CDC, business rules).
Apply data governance best practices (cataloguing, lineage, RBAC, masking of sensitive data).
Set upCI/CDand deployment pipelines (Azure DevOps / GitHub) for Databricks assets (notebooks, jobs, pipelines, workflows).
Using Terraform to automated IaaC setup and reusability
Monitor, optimize and troubleshoot pipelines and clusters for performance, robustness and cost efficiency.
Help define and implementbest practices, coding standards and reusable componentswithin the team.