Big Data Engineer

Virtusa; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading IT services company in the UAE is seeking a Senior Lead Software Engineer to develop and optimize data solutions in the banking sector. The role involves using cutting-edge technologies like Spark, Hive, and Kafka on cloud platforms, offering opportunities for professional growth and international experience.

Qualifications

• Over 7 years of experience in Big Data engineering required.
• Hands-on experience with Cloudera tools, Spark, and API development.
• Strong understanding of cloud data services.

Responsibilities

• Develop and optimize data pipelines using Spark, Hive, and Python.
• Design and develop APIs for data access and integration.
• Utilize Cloudera tools for job orchestration and data access.

Skills

Big Data Engineering

API Development

Data Security Controls

Distributed Systems

Cloud Data Services

Tools

Cloudera

Spark

Hive

Kafka

Python

Hue

Oozie

AWS

Azure

GCP

Job description

Role: Senior Lead Software Engineer

Skill: Big Data Engineer

Experience: 7 Years

Strong functional knowledge and experience in the banking domain.

Develop and optimize data pipelines using Spark, Hive, and Python on Cloudera.

Develop real-time data workflows using Kafka.

Design and develop APIs for data access and integration.

Utilize Hue, Oozie, and other Cloudera tools for job orchestration and data access.

Deploy solutions on cloud platforms such as AWS, Azure, or GCP.

Required Skills and Experience:

Over 7 years of experience in Big Data engineering.

Hands-on experience with Cloudera Spark, Hive, Kafka, Python, Hue, and Ranger.

Strong understanding of distributed systems and cloud data services.

Proficient in API development and data security controls.

About Virtusa:

Join Virtusa and gain international experience working on leading Digital Transformation programs in the Middle East.

Virtusa is a rapidly growing IT services company with a presence in the UAE, KSA, Qatar, and Oman, working with top clients in banking, finance, travel, telecom, and enterprise sectors. We have received awards from Gartner, IDC, WfMC, and others for our exceptional work.

Be part of our award-winning team that values teamwork, quality of life, and professional growth. Join a global community of 30,000 professionals committed to your development, working on exciting projects with cutting-edge technologies.