Azure data engineer

A2G Consulting BV (A2G Technologies); Amsterdam; On-site; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Visa sponsorship

Certification reimbursement

20 days holiday per year

Career development support

Job summary

A2G Consulting BV (A2G Technologies) is seeking a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure using Python, Azure Databricks, and Azure Data Factory.

The role focuses on data integration from multiple sources, REST API integration, ETL/ELT workflows, data validation, and collaboration with data architects and engineers. Visa sponsorship is available and a one-year contract with extension potential.

Qualifications

• Bachelor's or Master's degree or equivalent.
• Hands-on expertise in Python for data engineering.
• Experience with Azure Databricks (ADB).
• Experience with Azure Data Factory (ADF).
• Strong understanding of REST APIs and API integration.
• Experience developing and maintaining ETL/ELT pipelines.
• Knowledge of data ingestion, transformation, and validation.
• Strong troubleshooting and problem-solving skills.
• Ability to build scalable and reliable data solutions.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
• Build data processing and transformation workflows using Azure Databricks (ADB).
• Develop Python scripts for data ingestion, transformation, validation, and automation.
• Integrate external applications and data sources using REST APIs.
• Implement ETL/ELT processes to support data integration and analytics.
• Perform data cleansing, validation, and quality checks.
• Monitor pipeline execution and troubleshoot data processing issues.
• Optimise pipeline performance, reliability, and scalability.
• Collaborate with data architects, analysts, and engineering teams.
• Maintain technical documentation and follow data engineering best practices.

Skills

Azure Data Engineering

Python

Azure Databricks

Azure Data Factory

REST APIs

ETL/ELT pipelines

Data quality checks

Troubleshooting

Collaboration

Education

Bachelor's/Master's degree

Job description

Описание:

We are looking for a skilled Azure Data Engineer with hands‑on experience in Python, Azure Databricks, Azure Data Factory, and API integration. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, integrating data from multiple sources, and building reliable data processing solutions on Microsoft Azure.

Задачи:

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
• Build data processing and transformation workflows using Azure Databricks (ADB).
• Develop Python scripts for data ingestion, transformation, validation, and automation.
• Integrate external applications and data sources using REST APIs.
• Implement ETL/ELT processes to support data integration and analytics.
• Perform data cleansing, validation, and quality checks.
• Monitor pipeline execution and troubleshoot data processing issues.
• Optimise pipeline performance, reliability, and scalability.
• Collaborate with data architects, analysts, and engineering teams.
• Maintain technical documentation and follow data engineering best practices.

Требования:

• A Bachelor's or Master's Degree or equivalent.
• Strong experience in Microsoft Azure Data Engineering Hands-on expertise in Python
• Experience with Azure Databricks (ADB)
• Experience with Azure Data Factory (ADF)
• Strong understanding of REST APIs and API integration
• Experience developing and maintaining ETL/ELT pipelines
• Knowledge of data ingestion, transformation, and validation
• Strong troubleshooting and problem-solving skills
• Ability to build scalable and reliable data solutions

Условия:

• This position is for 1 year with possibility of extension.
• We offer competitive Gross Salary in line with the market standard.
• 20 days of holiday per year
• Encourage Personal Development - Certification (Certification Charges reimbursed)
• Income Tax Return Filing
• We provide Visa Sponsorship for Candidate & Dependants
• Possibility of bonus