Data Engineer

ITCAN PTE. LIMITED; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A technology solutions provider in Singapore is seeking a professional with extensive experience in Big Data technologies, stakeholder management, and background in banking or financial sectors. The ideal candidate will engage in large data migration projects, integrating various Data Science Workbench platforms, and employing Agile methodologies. Key responsibilities will encompass data preparation for analytics and model JSON schemas for organizational reuse.

Skills

Big Data experience

Stakeholder management

Experience in banking or financial business

Data migration projects

Integrating Data Science Workbench platforms

Agile project management

Data preparation for reporting and analytics

Tools

Hadoop

Hive

Spark

Presto

NiFi

MinIO

Kubernetes

Kafka

Tableau

Power BI

Python

Job description

Qualifications and Responsibilities

• . Hands-on Big Data experience using common open- source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka)
• . Experience in stakeholder management in heterogeneous business/technology organizations
• . Experience in banking or financial business, with handling sensitive data across regions
• . Experience in large data migration projects with on-prem Data Lakes
• . Hands-on experience in integrating Data Science Workbench platforms (e.g., Knime, Cloudera, Dataiku))
• . Track record in Agile project management and methods (e.g., Scrum, SAFe).
• . Covering all processes from enterprise reporting to data science (incl. ML Ops)
• * Maintain and model JSON based schemas and metadata. to re-use it across the organization (with central tools)
• * Data preparation for reporting/analytics and visualization tools (e.g. Tableau, Power BI or Python based)