Data Engineer (AVP)

OCBC; Singapore; On-site; SGD 120,000 - 210,000; Full time

Job summary

OCBC is seeking a Data Engineer (AVP) to build and improve data pipelines powering an enterprise-grade data warehouse and AI knowledge base. You will work closely with senior engineers and the Group Data Office to transform structured and unstructured data into reliable datasets for risk management, customer engagement, and intelligent automation.

You will lead batch and streaming development, orchestration with Airflow, cloud deployments, and API-backed data ingestion while growing into

Qualifications

• Diploma, Bachelor's or Master's degree in computer science or a related field.
• At least 5 years of experience in data engineering or related roles.
• Hands-on experience building data pipelines on modern data architectures including Data Warehouse, Lakehouse, and batch/real-time data processing systems.
• Working AI knowledge base concepts: vector databases, embeddings, and semantic search is a plus.
• Good experience on building data layers that support LLM / AI agent use cases is a plus.

Responsibilities

• Build and maintain batch and streaming data pipelines powering data warehouse/lakehouse platforms.
• Develop data models to support reusable analytical datasets and reporting foundations.
• Follow SLAs, monitor pipelines, and troubleshoot data issues.
• Develop and maintain Spark, SQL, Python or Java batch jobs; support real-time streaming with Flink.
• Collaborate with risk, marketing, operations, and AI teams to translate business needs into technical tasks.

Skills

Data engineering

Team collaboration

Problem solving

Education

Diploma, Bachelor's or Master's degree in computer science or a related field

Tools

Cloudera

BigQuery

Redshift

Spark

Airflow

Terraform

Job description

As Singapore's longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires.

As Singapore's longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires.

Today, we're on a journey of transformation. Leveraging technology and creativity to become a future-ready learning organisation. But for all that change, our strategic ambition is consistently clear and bold, which is to be Asia's leading financial services partner for a sustainable future.

We invite you to build the bank of the future. Innovate the way we deliver financial services. Work in friendly, supportive teams. Build lasting value in your community. Help people grow their assets, business, and investments. Take your learning as far as you can. Or simply enjoy a vibrant, future-ready career.

Your Opportunity Starts Here.

Data Engineer (AVP)

We are seeking a Data Engineer (AVP) to build, maintain, and continuously improve data pipelines that power enterprise-grade data warehouse, AI knowledge base within a banking environment. Working closely with senior engineers and the head of data engineering, you will help transform structured and unstructured data into reliable, reusable datasets and services that support use cases such as risk management, customer engagement, fraud detection, and intelligent automation. This is a hands-on engineering role with strong opportunities to grow into streaming, real-time, and AI-driven data product work.

This role reports to VP/ED, Data Engineering, Group data office.

Key Responsibilities

Batch & Streaming Data Pipeline Development

• Build and maintain data pipelines feeding data warehouse / lakehouse platforms (e.g., Cloudera, AWS Redshift or GCP BigQuery)
• Implement data models to support reusable analytical datasets and reporting foundations
• Follow established SLAs and monitoring practices, and help troubleshoot pipeline issues
• Develop and maintain batch data processing jobs using Spark, SQL, Python or Java
• Support and contribute to real-time streaming pipelines using Flink or similar tools, under senior guidance
• Assist in building and operating CDC pipelines (e.g., Debezium, Confluent or Fivetran)
• Build and maintain ingestion pipelines from APIs, GA4, and other data sources
• Implement messaging/streaming integrations using Pub/Sub and Kafka
• Write clean, well-tested SQL and Python scripts and data ingestion and processing pipelines

Orchestration & Automation

• Develop and maintain Airflow DAGs for scheduled and event-driven workflows
• Follow orchestration best practices established by senior engineers

Cloud Infrastructure & DevOps

• Deploy and support data workloads on Cloudera, GCP (Docker, Kubernetes, Cloud Run), AWS equivalent
• Contribute to and maintain CI/CD pipelines
• Use Terraform to provision and manage infrastructure under senior guidance
• Build and support REST APIs and backend services using Python / Flask
• Use Redis caching to meet performance requirements for data services

AI Knowledge Base & RAG Support

• Assist in building and maintaining vector database pipelines and embedding generation jobs under senior guidance
• Support to deliver processing and chunking workflows that feed AI knowledge bases and RAG pipelines
• Build, test and monitor semantic search / retrieval quality for AI-facing data layers
• undefined

Cross-functional Collaboration

• Work closely with senior data engineers, AI teams, and business stakeholders (Risk, Marketing, Operations)
• Help translate business requirements into technical implementation tasks
• Participate in code reviews and contribute to a culture of continuous improvement

Requirements

• Diploma, Bachelor's or Master's degree in computer science or a related field
• At least 5 years of experience in data engineering, data platforms, or related roles.
• Solid hands-on experience in build data pipelines on modern data architectures including Data Warehouse, Lakehouse, and batch/real-time data processing systems.
• Working AI knowledge base concepts: vector databases, embeddings, and semantic search is a plus
• Hands-on RAG pipeline components such as document chunking, embedding generation, and retrieval is a plus
• Good experience on building data layers that support LLM / AI agent use cases is a plus.
• Experience in banking or financial services is a plus

Technical Stack

• Data Warehouse / Platform: exposure to Cloudera, BigQuery, Redshift, or similar
• Batch Processing: Spark, SQL, ETL, Python, Map/Reduce
• Streaming: familiarity with Flink or other real-time processing engines (Good to have)
• CDC: exposure to Debezium, Confluent, Fivetran, or similar (Good to have)
• Data Ingestion: APIs, GA4, Pub/Sub, Kafka, Python pipelines
• Orchestration: Airflow or equivalents
• Cloud & Infrastructure: GCP or AWS; basic Docker/Kubernetes/Cloud Run experience
• DevOps / DataOps: exposure to CI/CD pipelines and Terraform
• Backend & Serving: Python, Flask, REST APIs; familiarity with Redis a plus

Additional Preferred Experience

• Eagerness to learn real-time / streaming architectures and low-latency system design
• Basic exposure to LLM applications, RAG, or AI agent concepts is a plus, not required
• Good product mindset and willingness to treat data as a product, not just a project
• Strong communication skills and comfort collaborating with both technical and business stakeholders

What We Offer

Competitive base salary. A suite of holistic, flexible benefits to suit every lifestyle. Community initiatives. Industry-leading learning and professional development opportunities. Your wellbeing, growth and aspirations are every bit as cared for as the needs of our customers.