Data Pipeline Engineer - Hadoop & Spark Platform

UNISYNC SYSTEMS PTE. LTD.

Dublin

On-site

EUR 90,000 - 130,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

UNISYNC SYSTEMS PTE. LTD. in Ireland is seeking a data engineer to design, build and deliver scalable data pipelines on Hadoop-based platforms, enabling enterprise data lake, warehouse and analytics across banking domains.

You will implement batch and near-real-time ingestion and transformation frameworks, optimize performance, ensure data quality and governance, and collaborate with platform teams to ensure reliable operations, deployment automation and end-to-end data availability.

Qualifications

  • Experience designing scalable data pipelines on Hadoop/Ecosystem.
  • Proficiency with Spark, HiveQL, Java, Python and SQL.
  • Experience with data ingestion, ETL/ELT and data lake governance.
  • Hands-on with CI/CD tools and DevOps practices.

Responsibilities

  • Design and maintain scalable data pipelines in the Data Lake.
  • Develop batch and near real-time ingestion frameworks.
  • Optimize data processing performance and reliability.
  • Collaborate with platform teams for workload management.
  • Provide production support and incident management.

Skills

Analytical thinking
Problem solving
Communication
Attention to detail

Tools

Hadoop
Cloudera CDP
Spark
Hive
Kafka
Python
Java
SQL
Unix/Linux scripting
Shell scripting
Oozie
YARN
ETL/ELT
Data Lake
Data Warehousing

Job description

UNISYNC SYSTEMS PTE. LTD. in Ireland is seeking a data engineer to design, build and deliver scalable data pipelines on Hadoop-based platforms, enabling enterprise data lake, warehouse and analytics across banking domains.

You will implement batch and near-real-time ingestion and transformation frameworks, optimize performance, ensure data quality and governance, and collaborate with platform teams to ensure reliable operations, deployment automation and end-to-end data availability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Architect – Banking & Big Data
Senior Data Platform Architect – Banking & Big Data

UNISYNC SYSTEMS PTE. LTD. • Dublin

On-site
EUR 90,000 - 120,000
Hybrid Data Platform Engineer: Scale Pipelines & ML
Hybrid Data Platform Engineer: Scale Pipelines & ML

Three • Ireland

Hybrid
EUR 90,000 - 140,000
Hybrid work model
Competitive salary + bonus
Pension contribution
+2
Senior Data Engineer: Scalable Pipelines & Real-Time Analytics
Senior Data Engineer: Scalable Pipelines & Real-Time Analytics

Prudential Financial, Inc. • Letterkenny

On-site
EUR 90,000 - 120,000
Senior Data Engineer — AI-Driven Pipelines
Senior Data Engineer — AI-Driven Pipelines

UnitedHealth Group • Dublin

Hybrid
EUR 90,000 - 120,000
Flexible work arrangements
Senior Data Engineer: Scalable Pipelines & Real-Time Data
Senior Data Engineer: Scalable Pipelines & Real-Time Data

Prudential Financial • Ireland

Remote
EUR 90,000 - 130,000
Senior Data Streaming & Infra Engineer – Hybrid Dublin
Senior Data Streaming & Infra Engineer – Hybrid Dublin

emagine Group • Dublin

Hybrid
EUR 90,000 - 120,000
Hybrid work
Senior Data Engineer - Hybrid (Snowflake, AI Tools)
Senior Data Engineer - Hybrid (Snowflake, AI Tools)

Optum • Dublin

Hybrid
EUR 85,000 - 120,000
Data Platform Engineer - Hybrid & AI-Driven ETL
Data Platform Engineer - Hybrid & AI-Driven ETL

MetLife, Inc. • Galway

Hybrid
EUR 45,000 - 60,000
Hybrid work
Private health insurance
Pension benefits
Senior Data Engineer — Hybrid (Dublin): Real-Time Pipelines
Senior Data Engineer — Hybrid (Dublin): Real-Time Pipelines

Xtremepush • Dublin

Hybrid
EUR 90,000 - 120,000
Senior Data Engineer: AI-Driven Data Pipelines (Hybrid)
Senior Data Engineer: AI-Driven Data Pipelines (Hybrid)

Optum • Dublin

Hybrid
EUR 90,000 - 120,000
Top locations