Hadoop / Big Data Engineer

HTC Global Services; Dubai; On-site; AED 201,000 - 312,000; Full time

Job summary

HTC Global Services in Dubai seeks a Hadoop/Big Data Engineer for a 1-year extendable on-site contract. You will join the Data Engineering team to design, develop, and manage data pipelines and data warehouses, while optimizing storage and ensuring data quality and security.

Responsibilities include streaming analytics, data ingestion for structured and semi-structured data, and documenting pipelines and processes for knowledge sharing. Prior Big Data stack experience is required.

Qualifications

• Experience designing data pipelines and data warehouses.
• Proficiency with Hadoop ecosystem and streaming analytics.
• Knowledge of data governance, quality, and security.

Responsibilities

• Be part of on-site Data Engineering team in Dubai.
• Design, develop, and manage data pipelines and warehousing.
• Optimize storage and monitor data infrastructure for reliability.
• Document pipelines and best practices for knowledge sharing.
• Work with structured and semi-structured data ingestion; streaming platforms.

Skills

Hadoop

Big Data

Data pipelines

Data warehousing

Streaming data

Tools

Scala

Spark

Hive

EMR

Lambda

Glue

Kafka

Redshift

SQL Server

Job description

Exciting Opportunity Alert! HTC Global Services is hiring Hadoop / Big Data Engineer for an 1-year extendable contract in Dubai, UAE (Onsite).

HTC Global Services - a leading CMM level 5 global provider of innovative IT and Business Process Services and Solutions since 1990 with headquarters in Troy, Michigan, USA.

Key Responsibilities

• To be part of Data Engineering team on-site


• Required to design, develop, and manage Data Pipelines & Data warehouse.


• Designing and optimizing data storage solutions


• Monitoring data infrastructure for performance and reliability to address issues promptly.


• Documenting data pipelines, processes, and best practices for knowledge sharing.


• Knowledge of data governance principles, ensuring data quality, security, and compliance


• Experience working with Structured and Semi structured data ingestion.


• Experience in Streaming data platform & analytics


• Experience working with Star/ Dimensional data modelling.


• Bigdata Stack –Scala, Hadoop, Spark, Hive, Shell Script, EMR, Step Function, Lambda, Glue, Sqoop, Flume/Kakfa


• Databases – Amazon Redshift, Oracle , SQL Server