Senior Databricks Platform Engineer - Remote 6m Contract

adesso Belgium; Belgique; Remote; EUR 90,000 - 150,000; Full time

Job summary

adesso Belgium is urgently seeking a Senior Databricks Platform Engineer to design and build robust data platforms. You will implement Lakehouse architectures, Delta Lake, Unity Catalog, and governance across batch and streaming pipelines using PySpark and Databricks Workflows.

The role covers CI/CD for Databricks assets, IaC with Terraform, and cost/performance optimization, in a flexible freelance setup for a 6-month engagement.

Qualifications

• Proven experience in design & build of data platforms.
• Expertise in Databricks architecture and governance.
• CI/CD and IaC for Databricks with Enterprise GitHub or similar.
• Terraform / IaC for cloud infrastructure and deployments.

Responsibilities

• Design & build data platforms using Databricks and lakehouse patterns.
• Implement Delta Lake, Unity Catalog, and data governance.
• Develop robust batch and streaming pipelines with PySpark.
• Set up CI/CD pipelines for notebooks, jobs, and workflows.
• Monitor, optimize, and troubleshoot pipelines for cost and performance.
• Collaborate to define best practices and reusable components.

Skills

Databricks architecture

Unity Catalog

CI/CD for Databricks

Terraform / IaC

Lakehouse design

Data product enablement

Knowledge graph / AI

Mode integration

Tools

Terraform

GitHub

Azure DevOps

Job description

adesso Belgium is urgently seeking a Senior Databricks Platform Engineer to design and build robust data platforms. You will implement Lakehouse architectures, Delta Lake, Unity Catalog, and governance across batch and streaming pipelines using PySpark and Databricks Workflows.

The role covers CI/CD for Databricks assets, IaC with Terraform, and cost/performance optimization, in a flexible freelance setup for a 6-month engagement.