Senior Data Platform Engineer - Hybrid, Driving Scale & AI

Basic-Fit; Hoofddorp; Hybrid; EUR 52,000 - 69,000; Full time

Benefits offered by this job

Learning & Development: GoodHabitz

Career Growth

Hybrid work model: 4 days in office, 1

Travel allowance

Bike plan

Health insurance discounts

Remote work allowance

Gym access

Job summary

Basic-Fit is hiring a Senior Data Platform Engineer to shape the data landscape and lead the migration of legacy pipelines to a modern Databricks platform. You will design scalable batch and streaming pipelines, co-own architectural decisions, and drive governance, cost control, and reliability across the platform.

You will collaborate with Data Platform Engineers, Analysts, BI Developers and Data Scientists in a multidisciplinary team.

Qualifications

• 3+ years of hands-on Databricks experience in production.
• Strong SQL, PySpark and Python, with a track record of clean, tested, maintainable code.
• Experience building and running production pipelines, both batch and streaming (e.g. Lakeflow/Delta Live Tables, Structured Streaming, Azure Data Factory).
• Experience with CI/CD and infrastructure as code (e.g. Azure DevOps, Terraform, Databricks Asset Bundles).
• Solid knowledge of data modelling, governance, security and cost optimisation on a cloud data platform.
• Experience contributing to architectural decisions or migrations, and explaining trade-offs to technical and non-technical colleagues.
• Excellent communication skills in English.

Responsibilities

• Design and build scalable batch and streaming pipelines in Databricks.
• Co-own architectural decisions and set standards for engineering, CI/CD and platform best practices.
• Drive migration of legacy pipelines to a modern Databricks platform.
• Drive performance, cost, governance and reliability across the platform.
• Evaluate and introduce new Databricks capabilities and take them from idea to production.
• Use AI and agents to automate engineering work and improve data quality.
• Share knowledge through code reviews and pairing with medior and junior engineers.

Skills

Databricks

SQL

PySpark

Python

CI/CD

Terraform

Azure Data Factory

Data modelling

Governance

Security

Cost optimisation

Architectural decisions

Migrations

English communication

Tools

Lakeflow

Delta Live Tables

Structured Streaming

Azure Data Factory

Job description

Basic-Fit is hiring a Senior Data Platform Engineer to shape the data landscape and lead the migration of legacy pipelines to a modern Databricks platform. You will design scalable batch and streaming pipelines, co-own architectural decisions, and drive governance, cost control, and reliability across the platform.

You will collaborate with Data Platform Engineers, Analysts, BI Developers and Data Scientists in a multidisciplinary team.