Senior Azure Data Engineer: Scale Data Pipelines Databricks

Stafide

Amsterdam

On-site

EUR 90,000 - 120,000

Full time

3 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Stafide is seeking a Senior Azure Data Engineer to design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks. You will build, implement, and optimize large-scale data processing solutions with PySpark and Databricks, and develop robust ETL processes using Python for data extraction, transformation, and loading.

You will work with SQL to query, process, transform, and manage large datasets, monitor and optimize pipelines for performance and reliability,

Qualifications

  • 8–10 years of overall IT experience, focused on data engineering and development.
  • Hands-on experience with Azure Data Factory for data integration and orchestration.
  • Strong expertise in Azure Databricks for scalable data processing and engineering solutions.
  • Proficiency in Python and PySpark for ETL development and big data processing.
  • Good knowledge of SQL and handling large datasets.

Responsibilities

  • Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
  • Build, implement, and optimize large-scale data processing solutions using PySpark and Databricks.
  • Develop robust ETL processes using Python for data extraction, transformation, and loading.

Skills

Python programming
SQL proficiency
PySpark

Tools

Azure Data Factory
Azure Databricks
PySpark
SQL

Job description

Stafide is seeking a Senior Azure Data Engineer to design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks. You will build, implement, and optimize large-scale data processing solutions with PySpark and Databricks, and develop robust ETL processes using Python for data extraction, transformation, and loading.

You will work with SQL to query, process, transform, and manage large datasets, monitor and optimize pipelines for performance and reliability,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Databricks Data Engineer
Senior Azure Databricks Data Engineer

Stafide • Amsterdam

On-site
EUR 90,000 - 150,000
Azure Data Engineer - Pipelines, Databricks & PySpark
Azure Data Engineer - Pipelines, Databricks & PySpark

Ubique Systems Gmbh. • Amsterdam

On-site
EUR 70,000 - 100,000
Senior Azure Data Engineer: Pipelines, Databricks & PySpark
Senior Azure Data Engineer: Pipelines, Databricks & PySpark

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Senior Azure Data Engineer (ID: 4146)
Senior Azure Data Engineer (ID: 4146)

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Data Engineer: Scale Data Pipelines in the Cloud
Data Engineer: Scale Data Pipelines in the Cloud

Sifra Thuss • Utrecht

Hybrid
EUR 70,000 - 90,000
Professional development
Azure & Databricks training
Azure Data Engineer: Lakehouse Pipelines & Spark Expert
Azure Data Engineer: Lakehouse Pipelines & Spark Expert

Stanley David and Associates • Utrecht

On-site
EUR 55,000 - 75,000
Senior Data Platform Engineer — Scale Databricks Pipelines
Senior Data Platform Engineer — Scale Databricks Pipelines

Basic-Fit • Hoofddorp

Hybrid
EUR 52,000 - 69,000
Learning & Development
Career Growth
Work Culture
+4
Senior Data Engineer: Azure Databricks & Scalable Pipelines
Senior Data Engineer: Azure Databricks & Scalable Pipelines

Harnham • Amsterdam

On-site
EUR 90,000 - 130,000
Azure Data Engineer
Azure Data Engineer

Ubique Systems Gmbh. • Amsterdam

On-site
EUR 70,000 - 100,000
Senior Data Platform Engineer - Pipelines & Databricks
Senior Data Platform Engineer - Pipelines & Databricks

RMM Consulting Group • Maastricht

Hybrid
EUR 70,000 - 100,000