Senior Azure Data Engineer (ID: 4146)

Stafide

Amsterdam

On-site

EUR 90,000 - 120,000

Full time

3 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Stafide is seeking a Senior Azure Data Engineer to design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks. You will build, implement, and optimize large-scale data processing solutions with PySpark and Databricks, and develop robust ETL processes using Python for data extraction, transformation, and loading.

You will work with SQL to query, process, transform, and manage large datasets, monitor and optimize pipelines for performance and reliability,

Qualifications

  • 8–10 years of overall IT experience, focused on data engineering and development.
  • Hands-on experience with Azure Data Factory for data integration and orchestration.
  • Strong expertise in Azure Databricks for scalable data processing and engineering solutions.
  • Proficiency in Python and PySpark for ETL development and big data processing.
  • Good knowledge of SQL and handling large datasets.

Responsibilities

  • Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
  • Build, implement, and optimize large-scale data processing solutions using PySpark and Databricks.
  • Develop robust ETL processes using Python for data extraction, transformation, and loading.

Skills

Python programming
SQL proficiency
PySpark

Tools

Azure Data Factory
Azure Databricks
PySpark
SQL

Job description

As a Senior Azure Data Engineer, you will:
  • Design, develop, and maintain complex data pipelines using Azure Data Factory (ADF) and Azure Databricks.
  • Build, implement, and optimize large-scale data processing solutions using PySpark and Databricks.
  • Develop robust ETL processes using Python for data extraction, transformation, and loading.
  • Design and implement CI/CD pipelines using Azure DevOps to automate testing, integration, and deployment.
  • Work with SQL to query, process, transform, and manage large datasets.
  • Monitor, troubleshoot, and optimize data pipelines to ensure performance, scalability, and reliability.
  • Collaborate with cross-functional teams to understand business and data requirements and deliver effective data solutions.
  • Ensure data security, quality, and compliance with established standards and best practices.
  • Stay up to date with emerging technologies and best practices in Azure cloud data engineering.
What You Bring to the Table:
  • 8–10 years of overall experience in IT, with strong experience in data engineering and development.
  • Hands‑on experience with Azure Data Factory for data integration, orchestration, and pipeline automation.
  • Strong expertise in Azure Databricks for scalable data processing and engineering solutions.
  • Proficiency in Python and PySpark for big data processing and ETL development.
  • Good knowledge of SQL and experience working with large datasets.
  • Experience developing, maintaining, and optimizing complex data pipelines.
  • Understanding of data security, data quality, and cloud data engineering best practices.
You should possess the ability to:
  • Design and develop scalable, reliable, and high-performance data engineering solutions.
  • Troubleshoot complex data pipeline issues and improve processing efficiency.
  • Work independently as well as collaboratively within cross-functional teams.
  • Analyze technical and business requirements and translate them into effective data solutions.
  • Apply problem-solving and analytical skills to overcome technical challenges.
  • Communicate technical concepts clearly and maintain proper technical documentation.
  • Adapt to evolving Azure technologies and modern data engineering practices.
What We Bring to the Table:
  • An opportunity to work on enterprise‑scale Azure data engineering solutions.
  • Exposure to modern cloud data technologies, including Azure Data Factory, Azure Databricks, and PySpark.
  • An opportunity to contribute to large‑scale data processing and automation initiatives.
Let’s Connect

Want to discuss this opportunity in more detail? Feel free to reach out.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer (ID: 4069)
Azure Data Engineer (ID: 4069)

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Azure Databricks Engineer (ID: 4047)
Azure Databricks Engineer (ID: 4047)

Stafide • Amsterdam

On-site
EUR 90,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Robson Bale • Eindhoven

On-site
EUR 60,000 - 80,000
Senior Azure Data Engineer: Scale Data Pipelines Databricks
Senior Azure Data Engineer: Scale Data Pipelines Databricks

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Azure Data Engineer
Azure Data Engineer

Ubique Systems Gmbh. • Amsterdam

On-site
EUR 70,000 - 100,000
Senior Azure Data Engineer: Pipelines, Databricks & PySpark
Senior Azure Data Engineer: Pipelines, Databricks & PySpark

Stafide • Amsterdam

On-site
EUR 90,000 - 120,000
Data & Software Engineer
Data & Software Engineer

Airswift • Den Haag

On-site
EUR 60,000 - 80,000
Azure Data Engineer
Azure Data Engineer

Stanley David and Associates • Utrecht

On-site
EUR 55,000 - 75,000
Senior Data Engineer - Azure
Senior Data Engineer - Azure

Harnham • Amsterdam

On-site
EUR 90,000 - 130,000
Senior Azure DevOps & Security Engineer
Senior Azure DevOps & Security Engineer

Stafide • Amsterdam

On-site
EUR 95,000 - 135,000