Data Engineer

InfoVision Middle East; Dubai; On-site; AED 260,000 - 480,000; Full time

Job summary

InfoVision Middle East is seeking an experienced Data Engineer to design, build, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate will work with Azure Databricks, Data Factory, Synapse, and Spark to transform complex data into valuable business insights.

You will collaborate with cross-functional teams to create robust data pipelines, integrate diverse data sources, and support enterprise analytics initiatives with a strong focus on data quality and

Qualifications

• Bachelor's degree in CS/IT/SE or related field.
• 5–7 years of experience as a Data Engineer in enterprise environments.
• Proven experience delivering Azure-based data engineering solutions in production environments.
• Experience with large-scale data platforms and modern cloud architectures.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Apache Spark.
• Integrate data from multiple sources into enterprise data platforms.
• Build reusable ETL/ELT processes for reliable data for reporting and analytics.
• Collaborate with business and technical teams to understand data requirements and deliver data solutions.
• Optimize data models, pipeline performance, and storage for scalability.
• Implement CI/CD practices using Azure DevOps to automate deployments.
• Support data quality, governance, and platform performance.

Skills

Azure Databricks

Python

SQL

Scala

Power BI

Azure DevOps

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Apache Spark

REST APIs

Docker

Kubernetes (AKS)

Education

Bachelor's degree in Computer Science, Information Technology, Software Engineering

Tools

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Apache Spark

Job description

We are looking for an experienced Data Engineer to design, build, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate will have strong expertise in Azure Data Services, Databricks, and Big Data technologies, with a passion for transforming complex data into valuable business insights.

You will work closely with cross-functional teams to develop robust data pipelines, integrate new data sources, and support enterprise analytics initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Apache Spark.
• Integrate structured, semi-structured, and unstructured data from multiple sources into enterprise data platforms.
• Build reusable ETL/ELT processes to ensure reliable, high-quality data for reporting and analytics.
• Collaborate with business and technical teams to understand data requirements and deliver efficient data solutions.
• Optimize data models, pipeline performance, and storage for scalability and reliability.
• Implement CI/CD practices using Azure DevOps to automate deployments.
• Support data quality, governance, and platform performance while ensuring adherence to best practices.
• Create technical documentation and contribute to continuous improvement of the data platform.

Required Skills

• Strong experience with Microsoft Azure Data Services, including Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
• Hands-on expertise in Apache Spark, Python, SQL, and Scala.
• Experience designing and optimizing ETL/ELT pipelines and Big Data architectures.
• Knowledge of Event Hub, Azure Functions, Docker, Kubernetes (AKS), and REST APIs.
• Familiarity with Power BI and Azure DevOps for deployment and automation.
• Strong analytical, problem-solving, and communication skills.

Qualifications & Experience

• Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field.
• 5–7 years of experience as a Data Engineer in enterprise environments.
• Proven experience delivering Azure-based data engineering solutions in production environments.
• Experience working with large-scale data platforms and modern cloud-based architectures is highly preferred.
• Strong analytical and troubleshooting skills.
• Excellent communication and stakeholder management abilities.
• Collaborative team player with a proactive mindset.
• Ability to thrive in a fast-paced, agile environment while delivering high-quality solutions.