Azure Data Engineer (Freelance) — Production Pipelines

Vivid Resourcing Ltd; Zuid-Holland; On-site; EUR 83,000 - 152,000; Part time

Job summary

Vivid Resourcing Ltd is seeking a Data Engineer for an initial 5-month freelance assignment in the Netherlands. You will work across data engineering, platform engineering and quantitative analytics, building scalable Azure-based data pipelines and productionising analytics prototypes.

Core tech includes Azure Databricks, Spark, Delta Lake, Python and SQL, with emphasis on batch and streaming pipelines, CI/CD and monitoring.

Qualifications

• Strong data engineering experience in Azure environments.
• Hands-on with Azure Databricks, Spark, Delta Lake, Workflows and Unity Catalog.
• Strong Python and SQL skills, with experience building batch and streaming pipelines.
• Experience taking analytical code into production and applying software engineering best practices, including testing, code reviews and CI/CD.
• Familiarity with Azure services such as ADLS Gen2, Azure DevOps, Key Vault and Data Factory.
• Strong stakeholder management skills and the ability to bridge business requirements and technical delivery.
• Experience with platform migration or modernisation.

Responsibilities

• Design, build and maintain Azure-based data pipelines and data products across batch and streaming workloads.
• Convert Python notebooks and analytical prototypes into robust, tested production solutions.
• Develop, deploy and monitor Azure Databricks workloads using Spark and Delta Lake.
• Collaborate with analysts and quantitative specialists to translate business needs into scalable technical solutions.
• Support data platform migration and modernisation initiatives.
• Improve engineering practices through testing, CI/CD, automation, monitoring and documentation.
• Optimise data transformations and reporting workloads while promoting best practices across the team.

Skills

Python

SQL

Data pipelines

Spark

Tools

Azure Databricks

Delta Lake

Azure Data Factory

Azure DevOps

Unity Catalog

ADLS Gen2

Terraform

Job description

Vivid Resourcing Ltd is seeking a Data Engineer for an initial 5-month freelance assignment in the Netherlands. You will work across data engineering, platform engineering and quantitative analytics, building scalable Azure-based data pipelines and productionising analytics prototypes.

Core tech includes Azure Databricks, Spark, Delta Lake, Python and SQL, with emphasis on batch and streaming pipelines, CI/CD and monitoring.