Azure Data Engineer — Scalable Pipelines, PySpark, ADF (Hybrid)

A2G Consulting BV (A2G Technologies)

Amsterdam

Hybrid

EUR 70,000 - 90,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

20 days holiday per year
Certification reimbursement
Income Tax Return Filing
Visa Sponsorship for Candidate & Dep./
Possibility of bonus

Job summary

A2G Consulting, also known as A2G Technologies, seeks an experienced Azure Data Engineer to design and manage scalable data pipelines in Amsterdam. You will work on ADF, Databricks, PySpark, and Python, building robust ETL/ELT processes and implementing CI/CD with Azure DevOps.

The role emphasizes data quality, security, and collaboration with cross-functional teams, with a 12-month contract and hybrid work arrangement in Amsterdam.

Qualifications

  • Bachelor's or Master's degree or equivalent.
  • Hands-on experience with Azure Data Factory (ADF).
  • Proven experience with Azure Databricks.
  • Strong Python and PySpark programming skills.
  • Experience designing and implementing complex data pipelines.
  • Hands-on experience with Azure DevOps and CI/CD pipelines.
  • Good knowledge of SQL and large-scale data processing.
  • Strong ETL/ELT concepts and data transformation.
  • Experience in performance tuning and troubleshooting data pipelines.
  • Proven Azure Data Engineer with strong analytical skills.

Responsibilities

  • Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
  • Build and optimize large-scale data processing solutions using PySpark.
  • Develop robust ETL/ELT workflows using Python.
  • Implement and manage CI/CD pipelines using Azure DevOps.
  • Work with large datasets and optimize data processing performance.
  • Monitor, troubleshoot, and maintain data pipelines to ensure reliability.
  • Collaborate with cross-functional teams to understand business and technical requirements.
  • Ensure data quality, security, and compliance with organizational standards.
  • Maintain technical documentation and follow data engineering best practices.

Skills

Azure Data Factory
Azure Databricks
PySpark
Python
CI/CD pipelines
SQL
ETL/ELT concepts
Documentation
Communication
Problem-solving

Education

Bachelor's or Master's Degree

Tools

Azure DevOps

Job description

A2G Consulting, also known as A2G Technologies, seeks an experienced Azure Data Engineer to design and manage scalable data pipelines in Amsterdam. You will work on ADF, Databricks, PySpark, and Python, building robust ETL/ELT processes and implementing CI/CD with Azure DevOps.

The role emphasizes data quality, security, and collaboration with cross-functional teams, with a 12-month contract and hybrid work arrangement in Amsterdam.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer - Pipelines, Databricks & PySpark
Azure Data Engineer - Pipelines, Databricks & PySpark

Ubique Systems Gmbh. • Amsterdam

On-site
EUR 70,000 - 100,000
Azure Data Platform Engineer — Flexible, Scalable Cloud Pipelines
Azure Data Platform Engineer — Flexible, Scalable Cloud Pipelines

GeekSoft Consulting • Amsterdam

Hybrid
EUR 90,000 - 130,000
International culture
Dutch benefits package
Flexible work mode
Azure Data Engineer
Azure Data Engineer

A2G Consulting BV (A2G Technologies) • Amsterdam

Hybrid
EUR 70,000 - 90,000
20 days holiday per year
Certification reimbursement
Income Tax Return Filing
+2
Senior Azure Data Engineer: Scale Pipelines with Databricks
Senior Azure Data Engineer: Scale Pipelines with Databricks

Stafide • Amsterdam

On-site
EUR 90,000 - 130,000
Azure Data Engineer — Scalable Pipelines & Cloud Solutions
Azure Data Engineer — Scalable Pipelines & Cloud Solutions

Ampstek • Utrecht

On-site
EUR 60,000 - 80,000
Azure Data Engineer - Data Pipelines & Platform (Hybrid)
Azure Data Engineer - Data Pipelines & Platform (Hybrid)

NN Group • Amsterdam

Hybrid
EUR 51,000 - 67,000
13e maand & vakantiegeld maandelijks
27 vakantiedagen + diversiteit dagen
Pensioenregeling BeFrank
+3
Azure Data Engineer: Lakehouse Pipelines & Spark Expert
Azure Data Engineer: Lakehouse Pipelines & Spark Expert

Stanley David and Associates • Utrecht

On-site
EUR 55,000 - 75,000
Senior Azure Databricks Data Engineer
Senior Azure Databricks Data Engineer

Stafide • Amsterdam

On-site
EUR 90,000 - 150,000
Data Engineer - Azure AI Pipelines & Dashboards
Data Engineer - Azure AI Pipelines & Dashboards

Atos Amplify • Amstelveen

Hybrid
EUR 60,000 - 80,000
Competitive salary
Year-end bonus
Pension scheme
+3
Azure Data Engineer: Pipelines & Databricks Expert
Azure Data Engineer: Pipelines & Databricks Expert

koinworx • Netherlands

On-site
EUR 90,000 - 120,000