Senior Azure Data Engineer: Scale Pipelines with Databricks

Stafide

Amsterdam

On-site

EUR 90,000 - 130,000

Full time

43 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Stafide is seeking a Senior Azure Data Engineer in Amsterdam to design and optimize enterprise data pipelines using Azure Data Factory and Azure Databricks. You will develop scalable PySpark solutions and robust Python ETL processes, ensuring secure, high-quality data processing across large datasets.

You will implement CI/CD with Azure DevOps, collaborate with cross-functional teams, and continuously improve data architectures to meet evolving business needs.

Qualifications

  • 8–10 years of IT experience with data engineering
  • Hands-on experience with Azure Data Factory for data integration, orchestration, and pipeline automation
  • Strong expertise in Azure Databricks for scalable data processing and engineering solutions
  • Proficiency in Python and PySpark for big data processing and ETL development
  • Good knowledge of SQL and experience working with large datasets
  • Experience developing, maintaining, and optimizing complex data pipelines
  • Understanding of data security, data quality, and cloud data engineering best practices

Responsibilities

  • Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
  • Build, implement, and optimize large-scale data processing solutions using PySpark and Databricks.
  • Develop robust ETL processes using Python for data extraction, transformation, and loading.
  • Design and implement CI/CD pipelines using Azure DevOps to automate testing, integration, and deployment.
  • Work with SQL to query, process, transform, and manage large datasets.
  • Monitor, troubleshoot, and optimize data pipelines to ensure performance, scalability, and reliability.
  • Collaborate with cross-functional teams to understand business and data requirements and deliver effective data solutions.
  • Ensure data security, quality, and compliance with established standards and best practices.
  • Stay up to date with emerging technologies and best practices in Azure cloud data engineering.

Skills

Python
PySpark
SQL
Data engineering

Tools

Azure Data Factory
Azure Databricks

Job description

Stafide is seeking a Senior Azure Data Engineer in Amsterdam to design and optimize enterprise data pipelines using Azure Data Factory and Azure Databricks. You will develop scalable PySpark solutions and robust Python ETL processes, ensuring secure, high-quality data processing across large datasets.

You will implement CI/CD with Azure DevOps, collaborate with cross-functional teams, and continuously improve data architectures to meet evolving business needs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Databricks Data Engineer
Senior Azure Databricks Data Engineer

Stafide • Amsterdam

On-site
EUR 90,000 - 150,000
Azure Data Engineer - Pipelines, Databricks & PySpark
Azure Data Engineer - Pipelines, Databricks & PySpark

Ubique Systems Gmbh. • Amsterdam

On-site
EUR 70,000 - 100,000
Azure Data Platform Engineer — Flexible, Scalable Cloud Pipelines
Azure Data Platform Engineer — Flexible, Scalable Cloud Pipelines

GeekSoft Consulting • Amsterdam

Hybrid
EUR 90,000 - 130,000
International culture
Dutch benefits package
Flexible work mode
Senior Data Engineer: Azure Databricks & Scalable Pipelines
Senior Data Engineer: Azure Databricks & Scalable Pipelines

Harnham • Amsterdam

On-site
EUR 90,000 - 130,000
Senior Azure Data Engineer: Pipelines, Databricks & PySpark
Senior Azure Data Engineer: Pipelines, Databricks & PySpark

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Databricks Data Engineer — Cloud Pipelines & AI Data
Databricks Data Engineer — Cloud Pipelines & AI Data

Devoteam • Amsterdam

Hybrid
EUR 70,000 - 100,000
Excellent salary
Bonus
Lease car
+5
Azure Data Engineer — Scalable Pipelines, PySpark, ADF (Hybrid)
Azure Data Engineer — Scalable Pipelines, PySpark, ADF (Hybrid)

A2G Consulting BV (A2G Technologies) • Amsterdam

Hybrid
EUR 70,000 - 90,000
20 days holiday per year
Certification reimbursement
Income Tax Return Filing
+2
Azure Data Engineer: Lakehouse Pipelines & Spark Expert
Azure Data Engineer: Lakehouse Pipelines & Spark Expert

Stanley David and Associates • Utrecht

On-site
EUR 55,000 - 75,000
Azure Data Engineer: Pipelines & Databricks Expert
Azure Data Engineer: Pipelines & Databricks Expert

koinworx • Netherlands

On-site
EUR 90,000 - 120,000
Senior Data Engineer | Databricks & AI-ML Pipelines
Senior Data Engineer | Databricks & AI-ML Pipelines

Vattenfall AB(Noord-Holland) • Noord-Holland

On-site
EUR 90,000 - 165,000
10% marge over tarief
Snel betalen binnen 1 werkdag
Geen concurrentiebeding