Azure Data Engineer: Scalable Pipelines & API-Driven ETL

A2G Consulting BV (A2G Technologies); Amsterdam; On-site; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Visa sponsorship

Certification reimbursement

20 days holiday per year

Career development support

Job summary

A2G Consulting BV (A2G Technologies) is seeking a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure using Python, Azure Databricks, and Azure Data Factory.

The role focuses on data integration from multiple sources, REST API integration, ETL/ELT workflows, data validation, and collaboration with data architects and engineers. Visa sponsorship is available and a one-year contract with extension potential.

Qualifications

• Bachelor's or Master's degree or equivalent.
• Hands-on expertise in Python for data engineering.
• Experience with Azure Databricks (ADB).
• Experience with Azure Data Factory (ADF).
• Strong understanding of REST APIs and API integration.
• Experience developing and maintaining ETL/ELT pipelines.
• Knowledge of data ingestion, transformation, and validation.
• Strong troubleshooting and problem-solving skills.
• Ability to build scalable and reliable data solutions.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
• Build data processing and transformation workflows using Azure Databricks (ADB).
• Develop Python scripts for data ingestion, transformation, validation, and automation.
• Integrate external applications and data sources using REST APIs.
• Implement ETL/ELT processes to support data integration and analytics.
• Perform data cleansing, validation, and quality checks.
• Monitor pipeline execution and troubleshoot data processing issues.
• Optimise pipeline performance, reliability, and scalability.
• Collaborate with data architects, analysts, and engineering teams.
• Maintain technical documentation and follow data engineering best practices.

Skills

Azure Data Engineering

Python

Azure Databricks

Azure Data Factory

REST APIs

ETL/ELT pipelines

Data quality checks

Troubleshooting

Collaboration

Education

Bachelor's/Master's degree

Job description

A2G Consulting BV (A2G Technologies) is seeking a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure using Python, Azure Databricks, and Azure Data Factory.

The role focuses on data integration from multiple sources, REST API integration, ETL/ELT workflows, data validation, and collaboration with data architects and engineers. Visa sponsorship is available and a one-year contract with extension potential.