Senior Big Data Engineer – Spark, Kafka, Cloud

Virtusa; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading IT services company in Dubai is looking for a Senior Lead Software Engineer specializing in Big Data. Candidates should have over 7 years of experience working with Cloudera, Spark, Hive, and Kafka, along with proficiency in API development. The role involves optimizing data pipelines and deploying solutions on cloud platforms. Join a dynamic team and engage in exciting digital transformation projects in the Middle East.

Qualifications

• 7 plus years of experience in Big Data engineering.
• Hands on with Cloudera, Spark, Hive, Kafka, Python, Hue, and Ranger.
• Strong understanding of distributed systems and cloud data services.

Responsibilities

• Develop and optimize data pipelines using Spark, Hive, and Python on Cloudera.
• Develop real-time data workflows using Kafka.
• Design and develop APIs for data access and integration.

Skills

Big Data engineering

Cloudera

Spark

Hive

Kafka

Python

Hue

Ranger

Job description

A leading IT services company in Dubai is looking for a Senior Lead Software Engineer specializing in Big Data. Candidates should have over 7 years of experience working with Cloudera, Spark, Hive, and Kafka, along with proficiency in API development. The role involves optimizing data pipelines and deploying solutions on cloud platforms. Join a dynamic team and engage in exciting digital transformation projects in the Middle East.