Senior Data Engineer Lead, Lakehouse & AI Data Platform

UOB; Singapore; On-site; SGD 160,000 - 230,000; Full time

Job summary

1011 United Overseas Bank Ltd in Singapore seeks a hands-on Senior Data Engineer to design and implement enterprise‑grade ingestion frameworks, Lakehouse data platforms and data products with governance and quality controls.

You will build Bronze/Silver/Gold layers, write Spark/Java/Python components, and collaborate with data scientists to operationalize ML models, while applying CI/CD, Kubernetes and OpenShift practices.

Qualifications

• Master’s degree in computer science or related field.
• },
• job_responsibilities_description:[

Responsibilities

• Design metadata‑driven ingestion frameworks supporting batch, CDC, streaming, APIs and files.
• Develop reusable Spark/Python components, orchestration, logging, monitoring and error handling.
• Build Bronze, Silver and Gold layers using Lakehouse principles.
• Design conceptual, logical and physical data models.
• Create business‑facing data products with metadata, lineage and SLAs.
• Implement data quality controls and observability.
• Performance tune Spark jobs and distributed processing workloads.
• Support DevOps, CI/CD and Infrastructure as Code practices.
• Strong Programming skills(java, python, sql)
• Build robust data ingestion and transformation frameworks using Java, Spark, Python, and shell scripting for ingesting multi model data.
• Strong hands on experience with Kubernetes, OpenShift, Docker, CI/CD, MLflow and observability tools.
• Ability to design data architectures supporting NLP and AI‑driven analytics, including ingestion, curation, and governance of unstructured data within Data Lake, Data warehouse platforms.
• Experience working with ML platforms such as CML, Spark MLlib, and Python ML libraries (scikit‑learn, XGBoost), including model deployment.
• Design and develop highly scalable, Real time systems using Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive, Ranger, Kafka, Flink and Nifi)
• Strong experience in building full agentic application with all the features(e.g mcp/tools/memory/rag)
• Experienced Cloud platforms and Cloud based app deployments with observability
• Strong exposure to AI‑driven risk scoring, fraud investigation and explainable AI use cases in banking.
• Develop full‑stack applications and internal engineering tools using Python, shell scripting, and modern web frameworks (e.g., Flask, React).
• Collaborate closely with data scientists to operationalize machine learning models using Cloudera Machine Learning (CML).
• Perform performance tuning and optimization of data applications on Hadoop to ensure optimal resource utilization

Skills

Java/Python/SQL

Spark (PySpark)

Data Modeling

API integration

Education

Master's degree in computer science

Tools

Apache Spark (PySpark)

Java

Python

SQL

Kubernetes

OpenShift

Docker

MLflow

CI/CD

Flask/React

Job description

1011 United Overseas Bank Ltd in Singapore seeks a hands-on Senior Data Engineer to design and implement enterprise‑grade ingestion frameworks, Lakehouse data platforms and data products with governance and quality controls.

You will build Bronze/Silver/Gold layers, write Spark/Java/Python components, and collaborate with data scientists to operationalize ML models, while applying CI/CD, Kubernetes and OpenShift practices.