Senior Data Engineer: Azure Data Pipelines & Databricks

Eneco; Rotterdam; Hybrid; EUR 88,000 - 131,000; Full time

Benefits offered by this job

FlexBudget

Hybrid working (office/home/abroad)

8% holiday allowance

Professional growth

Job summary

Eneco is hiring a Senior Data Engineer in Rotterdam to join a business-facing analytics team. You will design Azure-based data pipelines and Databricks workloads, turning notebooks into scalable production solutions and supporting a data platform migration.

You’ll collaborate with analysts, data scientists and quantitative specialists to align business goals with robust engineering practices, exploring batch and streaming data flows.

Qualifications

• Strong Data Engineering background in Azure cloud environments.
• Hands-on Azure Databricks experience, including Spark, Delta Lake, Workflows and Unity Catalog.
• Strong Python and SQL skills.
• Experience building batch and streaming data pipelines.
• Experience turning notebooks and analytical prototypes into production-grade solutions.
• Knowledge of testing, code reviews, CI/CD and software engineering best practices.
• Experience working directly with analysts, data scientists, quantitative specialists or business-oriented teams.
• A strong ability to balance business understanding with technical execution.
• Experience with Azure services such as ADLS Gen2, Azure DevOps, Key Vault, Data Factory or equivalent.
• Experience contributing to platform migration or modernization initiatives.

Responsibilities

• Act as an embedded engineer within a business-facing analytics and quantitative team.
• Lead and support the team through ongoing data platform migration initiatives.
• Design and maintain reliable Azure-based data pipelines and data products.
• Convert analyst-developed Python notebooks into tested, maintainable production solutions.
• Deploy, monitor and support Azure Databricks workloads in production.
• Work closely with analysts and quantitative specialists to translate business objectives and translate them into scalable technical solutions.
• Help professionalize the development lifecycle through testing, CI/CD, automation, monitoring and documentation.
• Optimize data transformations, models and reporting workloads.
• Provide technical guidance and help colleagues adopt sustainable engineering practices.
• Lead and support the team through ongoing data platform migration initiatives.

Skills

Azure Databricks

Python

SQL

Data pipelines

Batch & streaming

CI/CD

Software engineering best practices

Analyst collaboration

Azure cloud

Spark

Delta Lake

Unity Catalog

ADLS Gen2

Azure DevOps

Tools

Azure Databricks

Spark

Delta Lake

Workflows

Unity Catalog

Azure DevOps

Data Factory

Key Vault

AADLS Gen2

Job description

Eneco is hiring a Senior Data Engineer in Rotterdam to join a business-facing analytics team. You will design Azure-based data pipelines and Databricks workloads, turning notebooks into scalable production solutions and supporting a data platform migration.

You’ll collaborate with analysts, data scientists and quantitative specialists to align business goals with robust engineering practices, exploring batch and streaming data flows.