Azure Data Engineer: Big Data, Spark, Synapse & DevOps

IBS Software; United Arab Emirates; On-site; AED 300,000 - 540,000; Full time

Job summary

IBS Software in the United Arab Emirates is seeking a seasoned data engineering professional to design, implement and support data pipelines on Azure Data Factory, Spark and Hadoop-based ecosystems.

You will work with Azure SQL DB, Synapse Analytics and Power BI, applying industry best practices, data lake patterns, and CI/CD via Azure DevOps. Scrum/SAFe experience is desirable for fast-paced software delivery.

Qualifications

• Experience in developing and maintaining data pipelines on Azure Data Factory and big data ecosystems.
• Strong knowledge of Azure SQL DB and Synapse Analytics, Power BI, SSIS/SSRS, and T-SQL.
• Familiarity with Azure Data Lake, Analysis Services, Azure DevOps, CI/CD.
• Understanding of design patterns, industry best practices and standards.

Responsibilities

• Design, develop and support data pipelines and related data infrastructure.
• Collaborate across teams to ensure scalable, reliable data solutions.
• Apply Scrum practices and contribute to fast-paced software delivery.

Skills

Azure Data Factory

Spark

NoSQL

Azure Databricks

Hadoop Ecosystem

Hive

Impala

HDFS

YARN

Pig

Oozie

Azure SQL DB

Synapse Analytics

Power BI

SSIS

SSRS

T-SQL

Logic Apps

Azure Data Lake

Azure DevOps

CI/CD

Design patterns

Scrum

SAFe

Front-end design

UI testing

SDLC

Fast-paced environment

Tools

Azure DevOps

CI/CD

Power BI

Job description

IBS Software in the United Arab Emirates is seeking a seasoned data engineering professional to design, implement and support data pipelines on Azure Data Factory, Spark and Hadoop-based ecosystems.

You will work with Azure SQL DB, Synapse Analytics and Power BI, applying industry best practices, data lake patterns, and CI/CD via Azure DevOps. Scrum/SAFe experience is desirable for fast-paced software delivery.