Lead PySpark & Data Platform Architect

VirtusaPolaris - Virtusa Corporation; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading technology consulting firm in Dubai is seeking an experienced data management professional with expertise in Data Architecture and Strategy. The role involves driving delivery in a complex environment and independently managing tasks. Candidates must demonstrate experience in Big Data and strong communication skills, as well as familiarity with data processing frameworks like Hadoop and Spark.

Qualifications

• Expertise in Data Architecture, Data Strategy and Data Management.
• Experience in transforming traditional Data Warehousing approaches to Big Data.
• Strong problem solving, influencing, communication, and presentation skills.

Responsibilities

• Define workload migration strategies using appropriate tools.
• Drive delivery in a matrixed environment with various internal IT partners.
• Work independently and plan, estimate, and schedule tasks.

Skills

Data Architecture

Data Strategy

Data Governance

Data Quality

Big Data

Problem Solving

Communication

Hadoop

Python

Spark

Tools

Hadoop

Spark

Jenkins

Linux

Job description

A leading technology consulting firm in Dubai is seeking an experienced data management professional with expertise in Data Architecture and Strategy. The role involves driving delivery in a complex environment and independently managing tasks. Candidates must demonstrate experience in Big Data and strong communication skills, as well as familiarity with data processing frameworks like Hadoop and Spark.