Senior Data Platform Architect – Banking & Big Data

UNISYNC SYSTEMS PTE. LTD.

Dublin

Vor Ort

EUR 90.000 - 120.000

Vollzeit

Vor 8 Tagen

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

UNISYNC SYSTEMS PTE. LTD. is seeking an experienced Data Engineer to design and operate scalable data pipelines within an enterprise Data Lake, leveraging Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.

The role focuses on batch and near real-time ingestion to onboard diverse enterprise sources into the Lake. You will drive data quality and governance while collaborating with platform teams to optimize cluster utilization.

Qualifikationen

  • 10+ years of experience in data engineering or related field.
  • 5+ years managing Enterprise Data Lake/ DW or Big Data programs.
  • Experience in Hadoop/Cloudera environments is required.
  • Banking/Financial Services experience preferred.

Aufgaben

  • Design, develop and maintain scalable data pipelines in Enterprise Data Lake using Cloudera CDP/Hadoop/Spark/Hive/SQL.
  • Develop high-performance batch and real-time data ingestion for onboarding source systems.
  • Implement data transformations using Spark, HiveQL, SQL and Java-based processing.
  • Design and implement ingestion patterns for structured, semi-structured and unstructured data.
  • Build and maintain batch/near real-time data integration solutions.
  • Define source-to-target mappings and ingestion specs.

Kenntnisse

Stakeholder mgmt
Project delivery
Data engineering leadership
BAU portfolio mgmt

Tools

Hadoop
Cloudera CDP
Spark
Hive
Java
Python
SQL
Kafka
YARN/Oozie
Unix/Linux scripting
Shell scripting

Jobbeschreibung

UNISYNC SYSTEMS PTE. LTD. is seeking an experienced Data Engineer to design and operate scalable data pipelines within an enterprise Data Lake, leveraging Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.

The role focuses on batch and near real-time ingestion to onboard diverse enterprise sources into the Lake. You will drive data quality and governance while collaborating with platform teams to optimize cluster utilization.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Data Pipeline Engineer - Hadoop & Spark Platform
Data Pipeline Engineer - Hadoop & Spark Platform

UNISYNC SYSTEMS PTE. LTD. • Dublin

Vor Ort
EUR 90.000 - 130.000
Solution Architect
Solution Architect

UNISYNC SYSTEMS PTE. LTD. • Dublin

Vor Ort
EUR 90.000 - 120.000
APPLICATIONS DEVELOPER
APPLICATIONS DEVELOPER

UNISYNC SYSTEMS PTE. LTD. • Dublin

Vor Ort
EUR 90.000 - 130.000
Senior Data Engineer
Senior Data Engineer

PlayStation • Irland

Vor Ort
EUR 90.000 - 130.000
Senior Data Engineer: Scalable Pipelines & Governance
Senior Data Engineer: Scalable Pipelines & Governance

ACCENTURE PTE LTD • Dublin

Vor Ort
EUR 90.000 - 120.000
Data Engineer
Data Engineer

ACCENTURE PTE LTD • Dublin

Vor Ort
EUR 90.000 - 120.000
Senior Data Engineer - Lakehouse Pipelines & AI
Senior Data Engineer - Lakehouse Pipelines & AI

G MASS Consulting • Dublin

Vor Ort
EUR 90.000 - 130.000
Senior Data Engineer: Real-Time Pipelines & Kubernetes
Senior Data Engineer: Real-Time Pipelines & Kubernetes

HYPERSCAL SOLUTIONS PTE. LTD. • Dublin

Vor Ort
EUR 90.000 - 130.000
Senior Data Engineer
Senior Data Engineer

G MASS Consulting • Dublin

Vor Ort
EUR 90.000 - 130.000
SQL Developer – Core Banking Data Engineer
SQL Developer – Core Banking Data Engineer

U.S. Bank • Irland

Vor Ort
EUR 90.000 - 130.000
Top-Standorte