Lead Data Engineer

agap2 Netherlands; Randstad; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Laptop and mobile phone

Full travel allowance

Pension plan

25 vacation days

Flexible working hours

Weekly Dutch classes

Talent management budget

Team events

Job summary

agap2 Netherlands is seeking a Lead Data Engineer to blend hands-on development with engineering leadership. You will help establish best practices, raise engineering standards, and build reliable, scalable data platforms across Databricks, dbt, Spark, and Python.

You will mentor data engineers, drive modernization initiatives, and collaborate with stakeholders to enhance the data platform architecture. A dynamic, diverse team environment awaits.

Qualifications

• 5+ years of experience in data engineering.
• Experience leading data platform modernisation or migration.
• Strong practical experience with dbt (data build tool).
• Experience working with dbt and Databricks together, ideally in a migration or transformation.
• Strong knowledge of Python, SQL, and Apache Spark.
• Knowledge of automated testing, CI/CD, data quality, and observability.
• Experience designing and maintaining scalable data pipelines and reviewing technical solutions.
• Ability to mentor engineers while remaining actively involved in development.
• Excellent communication and collaboration skills.

Responsibilities

• Contribute hands-on to the transition from Databricks towards a dbt-driven data transformation approach.
• Design, develop, and maintain scalable data pipelines and data transformation workflows.
• Establish and promote engineering best practices across dbt, Databricks, Spark, and Python.
• Improve code quality, automated testing, data quality, observability, and CI/CD processes.
• Support the development of reliable batch and streaming data platforms processing millions of records.
• Provide technical guidance and mentorship to other data engineers.
• Drive engineering excellence, maintainability, and consistency across data engineering solutions.
• Collaborate with stakeholders and engineering teams to improve the data platform and its architecture.

Skills

Data engineering

Python

SQL

Apache Spark

CI/CD

Data quality

Observability

Mentoring

Communication

Tools

dbt

Databricks

Job description

The position

As a Lead Data Engineer, you will combine strong technical expertise with engineering leadership. You will contribute directly to development while establishing best practices, improving engineering standards, and helping the data engineering team build reliable, scalable, and maintainable data platforms.

You will work with modern data technologies, including Databricks, dbt, Spark, and Python, supporting data solutions across multiple

Your Responsibilities

• Contribute hands-on to the transition from Databricks towards a dbt-driven data transformation approach.
• Design, develop, and maintain scalable data pipelines and data transformation workflows.
• Establish and promote engineering best practices across dbt, Databricks, Spark, and Python.
• Improve code quality, automated testing, data quality, observability, and CI/CD processes.
• Support the development of reliable batch and streaming data platforms processing millions of records.
• Provide technical guidance and mentorship to other data engineers.
• Drive engineering excellence, maintainability, and consistency across data engineering solutions.
• Collaborate with stakeholders and engineering teams to improve the data platform and its architecture.

What you bring

• At least 5 years of experience in data engineering.
• Experience leading data platform modernisation or migration initiatives.
• Strong practical experience with dbt (data build tool).
• Experience working with dbt and Databricks together, ideally in a data platform migration or transformation.
• Strong knowledge of Python, SQL, and Apache Spark.
• Knowledge of automated testing, CI/CD, data quality, and observability.
• Experience designing and maintaining scalable data pipelines and reviewing technical solutions.
• Ability to mentor engineers while remaining actively involved in development.
• Excellent communication and collaboration skills.

Nice to have

• Experience with batch and streaming data architectures.
• Experience working in large-scale enterprise data environments.
• Experience with dbt Core or dbt Cloud.

What we offer

• Competitive Salary & Benefits: Including a laptop, mobile phone, full travel allowance, and pension plan.
• Work-Life Balance: 25 vacation days, flexible working hours in a
• Professional Growth:: Weekly Dutch classes and a tailored talent management program with a financial budget to help you achieve your professional goals
• Dynamic Culture: Diverse team activities from tech meetups to sports and social events.

Is there still room for fun?

Of course! The combination of fun and development is essential in our team. A small impression: our team consists of more than 10 nationalities, we play paddle and regularly organize tech meetups, happy hours drinks, and pub quizzes.

At agap2 we defend equality and value diversity. We create a safe, diverse environment where opportunities are equal for all employees. All candidates with skills matching the position are welcome to join us!