Data Engineering Manager: Scalable Pipelines & AI

OCBC; Singapore; Vor Ort; SGD 120.000 - 180.000; Vollzeit

Zusammenfassung

OCBC is seeking a Data Engineer (Manager) to design and maintain data pipelines for enterprise data warehouse and AI knowledge bases in a banking context. You will transform structured and unstructured data into reliable datasets supporting risk, customer engagement, and fraud use cases.

The role offers hands-on opportunities across cloud, streaming, and AI-enabled data engineering under the guidance of senior engineers.

Qualifikationen

• Bachelor’s degree in computer science, information systems, engineering, or related field.
• At least 2 years of relevant experience in data engineering, data platforms, software engineering, or related roles.
• Hands-on experience building or supporting data pipelines using SQL and Python in a data warehouse, data lake, or cloud environment.
• Basic knowledge of AI knowledge base concepts, such as vector databases, embeddings, or semantic search, is a plus
• Exposure to RAG components, such as document chunking, embedding generation, or retrieval, is a plus
• Exposure to data layers supporting LLM or AI agent use cases is a plus

Aufgaben

• Develop and support data pipelines feeding data lake/data warehouse platforms.
• Support the implementation of data models for reusable analytical datasets and reporting.
• Monitor data pipelines against SLAs and assist in troubleshooting data quality issues.
• Develop and maintain batch processing jobs using Spark, SQL, Python, or Java.
• Assist with real-time streaming pipelines using Flink or similar tools.
• Build and support ingestion pipelines from APIs, GA4, files, and other data sources.
• Support messaging and streaming integrations using Pub/Sub or Kafka.
• Write clean, tested SQL and Python code for data ingestion and processing.
• Collaborate with cross-functional teams to translate business requirements into technical tasks

Kenntnisse

Data pipelines

SQL

Python

Batch processing

Streaming processing

Ausbildung

Bachelor's degree in CS/IS/Engineering

Tools

Cloudera

Redshift

Snowflake

Spark

Flink

Airflow

Docker

Kubernetes

Cloud Run

Jobbeschreibung

OCBC is seeking a Data Engineer (Manager) to design and maintain data pipelines for enterprise data warehouse and AI knowledge bases in a banking context. You will transform structured and unstructured data into reliable datasets supporting risk, customer engagement, and fraud use cases.

The role offers hands-on opportunities across cloud, streaming, and AI-enabled data engineering under the guidance of senior engineers.