Senior PySpark Data Engineer for Banking Pipelines

Innovations Global; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading tech firm in Dubai is searching for a skilled Data Engineer with expertise in PySpark. The role involves designing and optimizing large-scale data pipelines within the banking domain. Candidates should possess at least 5 years of experience, strong SQL skills, and working knowledge of Cloudera Data Platform. This position requires the ability to collaborate with various teams to support critical financial applications and deliver high-quality data solutions.

Qualifications

• 5+ years of experience as a Data Engineer with banking domain exposure.
• Hands-on experience with Cloudera Data Platform.
• Solid understanding of Hadoop ecosystem tools and Kafka.

Responsibilities

• Develop, optimize, and maintain PySpark-based data pipelines for large-scale processing.
• Work with Cloudera Data Platform components including Hive and HDFS.
• Design and implement scalable ETL workflows aligned with banking data requirements.

Skills

Advanced proficiency in PySpark

SQL skills

Hadoop ecosystem tools

Linux scripting (Bash/Python)

Education

Bachelor’s or Master’s in Computer Science, Data Engineering, IT

Tools

Cloudera Data Platform

Hive

Impala

Oozie

Airflow

Job description

A leading tech firm in Dubai is searching for a skilled Data Engineer with expertise in PySpark. The role involves designing and optimizing large-scale data pipelines within the banking domain. Candidates should possess at least 5 years of experience, strong SQL skills, and working knowledge of Cloudera Data Platform. This position requires the ability to collaborate with various teams to support critical financial applications and deliver high-quality data solutions.