APPLICATIONS DEVELOPER

UNISYNC SYSTEMS PTE. LTD.

Dublin

On-site

EUR 90,000 - 130,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

UNISYNC SYSTEMS PTE. LTD. in Ireland is seeking a data engineer to design, build and deliver scalable data pipelines on Hadoop-based platforms, enabling enterprise data lake, warehouse and analytics across banking domains.

You will implement batch and near-real-time ingestion and transformation frameworks, optimize performance, ensure data quality and governance, and collaborate with platform teams to ensure reliable operations, deployment automation and end-to-end data availability.

Qualifications

  • Experience designing scalable data pipelines on Hadoop/Ecosystem.
  • Proficiency with Spark, HiveQL, Java, Python and SQL.
  • Experience with data ingestion, ETL/ELT and data lake governance.
  • Hands-on with CI/CD tools and DevOps practices.

Responsibilities

  • Design and maintain scalable data pipelines in the Data Lake.
  • Develop batch and near real-time ingestion frameworks.
  • Optimize data processing performance and reliability.
  • Collaborate with platform teams for workload management.
  • Provide production support and incident management.

Skills

Analytical thinking
Problem solving
Communication
Attention to detail

Tools

Hadoop
Cloudera CDP
Spark
Hive
Kafka
Python
Java
SQL
Unix/Linux scripting
Shell scripting
Oozie
YARN
ETL/ELT
Data Lake
Data Warehousing

Job description

Develop and deliver scalable transformation frameworks across Hadoop platforms by building robust data pipelines, ingestion frameworks, and automation capabilities. Ensure efficient data processing, performance optimization, and reliable integration of enterprise data sources, while supporting data warehouse, enterprise analytics and downstream consumption requirements. This role offers an opportunity to work on large-scale data platforms handling structured, semi-structured, and streaming data across critical banking domains.

REQUIREMENTS
Data Engineering & Integration
  • Design, develop, and maintain scalable data pipelines within the Enterprise Data Lake platform using Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.
  • Develop high-performance batch and near real-time data ingestion frameworks for onboarding enterprise source systems into the Data Lake.
  • Develop complex transformation logic using Spark, HiveQL, SQL, and Java-based processing frameworks.
  • Design and implement data ingestion patterns supporting structured, semi-structured, and unstructured datasets.
  • Build and maintain batch and near real-time data integration solutions.
  • Implement source-to-target mappings and ingestion specifications.
Hadoop & Cloudera Platform Development
  • Develop and support solutions within the Cloudera Data Platform ecosystem.
  • Build and maintain data pipelines leveraging:
    • Hadoop HDFS
    • Hive
    • Impala
    • Spark
    • Kafka
    • YARN, Oozie
  • Perform deployment, troubleshooting, and performance tuning of applications running on the Hadoop ecosystem.
  • Partner with platform teams to ensure optimal cluster utilization and workload management.
Data Quality & Governance
  • Ensure adherence to Data Lake onboarding standards and governance requirements.
  • Investigate and resolve data quality issues and production incidents.
  • Ensure compliance with enterprise data governance standards.
DevOps & Platform Automation
  • Integrate data engineering solutions into CI/CD pipelines using Git, Jenkins, Azure DevOps, or equivalent tools.
  • Automate deployment, testing, monitoring, and operational support activities.
  • Develop reusable frameworks and utilities to improve engineering productivity and platform scalability.
Production Support & Incident Management
  • Provide L3 support for Data Lake application.
  • Perform root cause analysis for production incidents and implement permanent fixes.
  • Monitor pipeline execution, cluster health, and workload performance.
  • Participate in release implementation, deployment validation, and post-production support activities.
  • Strong hands on experience with Hadoop ecosystem and data pipeline orchestration.
  • Hadoop/HDFS
  • Hive
  • Spark
  • Unix/Linux scripting
  • Shell scripting
  • ETL/ELT development experience.
  • Data modelling fundamentals.
  • Performance tuning and optimization.
  • Experience in Data Warehousing and Data Lake environments.
  • Strong Java / Python competency with experiences.
  • Strong SQL development skills.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Solution Architect
Solution Architect

UNISYNC SYSTEMS PTE. LTD. • Dublin

On-site
EUR 90,000 - 120,000
Data Engineer
Data Engineer

ACCENTURE PTE LTD • Dublin

On-site
EUR 90,000 - 120,000
Senior Data Engineer
Senior Data Engineer

PlayStation • Ireland

On-site
EUR 90,000 - 130,000
Senior Data Platform Architect – Banking & Big Data
Senior Data Platform Architect – Banking & Big Data

UNISYNC SYSTEMS PTE. LTD. • Dublin

On-site
EUR 90,000 - 120,000
Senior Data Engineer - Lakehouse Pipelines & AI
Senior Data Engineer - Lakehouse Pipelines & AI

G MASS Consulting • Dublin

On-site
EUR 90,000 - 130,000
Data Engineer - Python / Databricks
Data Engineer - Python / Databricks

Cpl Group • Dublin

On-site
EUR 110,000 - 160,000
Senior Data Engineer
Senior Data Engineer

G MASS Consulting • Dublin

On-site
EUR 90,000 - 130,000
Sr. Staff Platform Operations Engineer
Sr. Staff Platform Operations Engineer

Cloudera • Ireland

On-site
EUR 150,000 - 190,000
Generous PTO Policy
Unplugged Days
Flexible WFH Policy
+7
Senior Engineer (R-20003)
Senior Engineer (R-20003)

Dun & Bradstreet • Dublin

On-site
EUR 120,000 - 180,000
Senior Staff Platform Operations Engineer (with OpenStack)
Senior Staff Platform Operations Engineer (with OpenStack)

Cloudera • Ireland

On-site
EUR 90,000 - 150,000
Comprehensive medical, dental, and視ion
On-site gyms at various locations
Gym reimbursement
+8
Top locations