Azure Data Engineer: Build Scalable Pipelines & Insights

InfoVision Middle East; Dubai; On-site; AED 260,000 - 480,000; Full time

Job summary

InfoVision Middle East is seeking an experienced Data Engineer to design, build, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate will work with Azure Databricks, Data Factory, Synapse, and Spark to transform complex data into valuable business insights.

You will collaborate with cross-functional teams to create robust data pipelines, integrate diverse data sources, and support enterprise analytics initiatives with a strong focus on data quality and

Qualifications

• Bachelor's degree in CS/IT/SE or related field.
• 5–7 years of experience as a Data Engineer in enterprise environments.
• Proven experience delivering Azure-based data engineering solutions in production environments.
• Experience with large-scale data platforms and modern cloud architectures.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Apache Spark.
• Integrate data from multiple sources into enterprise data platforms.
• Build reusable ETL/ELT processes for reliable data for reporting and analytics.
• Collaborate with business and technical teams to understand data requirements and deliver data solutions.
• Optimize data models, pipeline performance, and storage for scalability.
• Implement CI/CD practices using Azure DevOps to automate deployments.
• Support data quality, governance, and platform performance.

Skills

Azure Databricks

Python

SQL

Scala

Power BI

Azure DevOps

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Apache Spark

REST APIs

Docker

Kubernetes (AKS)

Education

Bachelor's degree in Computer Science, Information Technology, Software Engineering

Tools

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Apache Spark

Job description

InfoVision Middle East is seeking an experienced Data Engineer to design, build, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate will work with Azure Databricks, Data Factory, Synapse, and Spark to transform complex data into valuable business insights.

You will collaborate with cross-functional teams to create robust data pipelines, integrate diverse data sources, and support enterprise analytics initiatives with a strong focus on data quality and