Senior Data Platform Engineer - Scalable Databricks Pipelines

Basic Fit Nederland; Hoofddorp; Hybrid; EUR 52,000 - 69,000; Full time

Benefits offered by this job

GoodHabitz access

LinkedIn Learning access

Travel allowance

Bike plan

Health insurance discounts

Remote work allowance

Gym access

Job summary

Basic-Fit is building a data platform powering millions of workouts across Europe. As a Senior Data Platform Engineer, you’ll join the central Data Platform Team to shape the direction and build the platform hands-on.

In a typical week you’ll design and run scalable pipelines in Databricks, drive architecture decisions, migrate legacy pipelines, improve governance and cost, explore Lakeflow and Databricks capabilities, and mentor junior engineers while collaborating with analysts, BI developers

Qualifications

• 3+ years of hands-on Databricks experience in production.
• Strong SQL, PySpark and Python, with a track record of clean, tested, maintainable code.
• Experience building and running production pipelines, both batch and streaming (e.g. Lakeflow/Delta Live Tables, Structured Streaming, Azure Data Factory)
• Experience with CI/CD and infrastructure as code (e.g. Azure DevOps, Terraform, Databricks Asset Bundles)
• Solid knowledge of data modelling, governance, security and cost optimisation on a cloud data platform
• Experience contributing to architectural decisions or migrations, and explaining trade-offs to technical and non-technical colleagues
• Excellent communication skills in English

Responsibilities

• Design and build scalable batch and streaming pipelines in Databricks.
• Co-own architectural decisions and set standards for engineering, CI/CD and platform best practices.
• Take a driving role in the migration of legacy pipelines to a modern Databricks platform.
• Drive performance, cost, governance, and reliability across the platform.
• Evaluate and introduce new Databricks capabilities (Lakeflow Connect, Databricks Apps, dashboards) and take them from idea to production.
• Use AI and agents to automate engineering work and improve data quality.
• Share your knowledge with medior and junior engineers through code reviews and pairing.

Skills

Databricks

SQL

PySpark

Python

CI/CD

Terraform

Data modeling

Governance

English

Tools

Azure DevOps

Delta Live Tables

Lakeflow

Databricks Apps

Terraform

Job description

Basic-Fit is building a data platform powering millions of workouts across Europe. As a Senior Data Platform Engineer, you’ll join the central Data Platform Team to shape the direction and build the platform hands-on.

In a typical week you’ll design and run scalable pipelines in Databricks, drive architecture decisions, migrate legacy pipelines, improve governance and cost, explore Lakeflow and Databricks capabilities, and mentor junior engineers while collaborating with analysts, BI developers