Lead Data Engineer: dbt & Databricks Platform Modernization

agap2 Netherlands; Randstad; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

Laptop and mobile phone

Full travel allowance

Pension plan

25 vacation days

Flexible working hours

Weekly Dutch classes

Talent management budget

Team events

Zusammenfassung

agap2 Netherlands is seeking a Lead Data Engineer to blend hands-on development with engineering leadership. You will help establish best practices, raise engineering standards, and build reliable, scalable data platforms across Databricks, dbt, Spark, and Python.

You will mentor data engineers, drive modernization initiatives, and collaborate with stakeholders to enhance the data platform architecture. A dynamic, diverse team environment awaits.

Qualifikationen

• 5+ years of experience in data engineering.
• Experience leading data platform modernisation or migration.
• Strong practical experience with dbt (data build tool).
• Experience working with dbt and Databricks together, ideally in a migration or transformation.
• Strong knowledge of Python, SQL, and Apache Spark.
• Knowledge of automated testing, CI/CD, data quality, and observability.
• Experience designing and maintaining scalable data pipelines and reviewing technical solutions.
• Ability to mentor engineers while remaining actively involved in development.
• Excellent communication and collaboration skills.

Aufgaben

• Contribute hands-on to the transition from Databricks towards a dbt-driven data transformation approach.
• Design, develop, and maintain scalable data pipelines and data transformation workflows.
• Establish and promote engineering best practices across dbt, Databricks, Spark, and Python.
• Improve code quality, automated testing, data quality, observability, and CI/CD processes.
• Support the development of reliable batch and streaming data platforms processing millions of records.
• Provide technical guidance and mentorship to other data engineers.
• Drive engineering excellence, maintainability, and consistency across data engineering solutions.
• Collaborate with stakeholders and engineering teams to improve the data platform and its architecture.

Kenntnisse

Data engineering

Python

SQL

Apache Spark

CI/CD

Data quality

Observability

Mentoring

Communication

Tools

dbt

Databricks

Jobbeschreibung

agap2 Netherlands is seeking a Lead Data Engineer to blend hands-on development with engineering leadership. You will help establish best practices, raise engineering standards, and build reliable, scalable data platforms across Databricks, dbt, Spark, and Python.

You will mentor data engineers, drive modernization initiatives, and collaborate with stakeholders to enhance the data platform architecture. A dynamic, diverse team environment awaits.