Data Scientist, Platform AI Squad, Group Data Office (AVP/VP)

OCBC Bank; Singapore; On-site; SGD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive base salary

Flexible benefits and learning support

Professional development opportunities

Job summary

OCBC Bank in Singapore is seeking a Data Scientist for the Platform AI Squad, Group Data Office (AVP/VP). You will design, optimize, and maintain the enterprise cloud infrastructure and AI frameworks powering Enterprise AI across the bank, bridging AI engineering with cloud platform operations.

You will work on multi-agent frameworks, low-latency LLM inference, DevOps pipelines, and scalable production microservices, applying MLOps practices to deliver reliable AI solutions in a highly regulated

Qualifications

• Bachelor’s degree or higher in CS/AI/quantitative field.
• AVP level requires 4+ years of hands‑on LLM apps, MLOps, and AWS deployments.
• VP level calls for 8+ years of production AI platform leadership.

Responsibilities

• Build and scale multi-agent orchestration frameworks integrated with AWS.
• Deploy and maintain low-latency LLM serving across on‑prem and cloud GPUs.
• Maintain CI/CD workflows for model testing, containerization, and release management.
• Configure telemetry for latency, costs, drift, and reliability in prod.

Skills

LLM applications

MLOps

Cloud architecture

Python

DevOps tooling

Education

Bachelor’s/Master’s/PhD in CS/Data Science/AI or quantitative field

Tools

Python

LangChain/LangGraph

LlamaIndex

AWS

Docker

Kubernetes (EKS)

Terraform

Helm

Git

GitOps (ArgoCD)

MLflow

Bedrock/SageMaker

Job description

WHO WE ARE: As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires. Today, we’re on a journey of transformation. Leveraging technology and creativity to become a future-ready learning organisation. But for all that change, our strategic ambition is consistently clear and bold, which is to be Asia’s leading financial services partner for a sustainable future. We invite you to build the bank of the future. Innovate the way we deliver financial services. Work in friendly, supportive teams. Build lasting value in your community. Help people grow their assets, business, and investments. Take your learning as far as you can. Or simply enjoy a vibrant, future-ready career. Your Opportunity Starts Here.

Data Scientist, Platform AI Squad, Group Data Office (AVP/VP)

About the Role As a Data Scientist, Platform AI Squad, Group Data Office, you will design, optimize, and maintain the enterprise cloud infrastructure and software frameworks powering Enterprise AI across the bank. Operating at the intersection of AI application engineering, high-performance inference, and cloud platform engineering, you will work across Agentic AI frameworks and applications, low-latency LLM inference stacks leveraging hybrid-cloud services, and platform-level MLOps/DevOps pipelines. In this role, you will establish standardized MLOps processes, optimize LLM inference, architect and build end-to-end AI solutions, maintain production pipelines, and drive enterprise AI engineering best practices.

Key Responsibilities

• 1. Agentic AI Platforms & Frameworks
  • Build and scale multi-agent orchestration frameworks (LangGraph, AutoGen, CrewAI) integrated with AWS.
  • Design and implement reusable, enterprise-grade agentic platform components and applications.
  • Implement function-calling harnesses and modern protocols (Model Context Protocol / MCP, A2A) connecting LLMs to databases (e.g., AWS Aurora, DynamoDB), vector stores, and enterprise APIs.
  • Integrate managed cloud services (Amazon Bedrock Agents & Knowledge Bases) alongside custom open-source agent frameworks.
  • Deploy automated evaluation pipelines (RAGAS, DeepEval, Bedrock Guardrails) to validate tool-calling precision, hallucination rates, and prompt safety before production release.
• 2. LLM Inference Optimization & Model Lifecycle
  • Deploy and maintain low-latency LLM serving engines (vLLM, TensorRT-LLM, TGI, SGLang) across on-premises GPU clusters and cloud infrastructure.
  • Establish GPU capacity planning, utilization tracking, monitoring, and budgeting processes.
  • Oversee automated model versioning, artifact storage, and metadata tracking using MLflow or Amazon SageMaker Model Registry.
  • Integrate foundation models via Amazon Bedrock and Amazon SageMaker AI for serverless scaling and hybrid workload routing.
  • Package models into production-ready microservices supporting REST/gRPC APIs, batch processing, and streaming inference.
  • Implement PagedAttention, Dynamic Batching, KV Cache offloading, and Speculative Decoding to minimize Time-to-First-Token (TTFT) and maximize token throughput.
• 3. AWS Cloud Architecture, MLOps & Daily DevOps Support
  • Provide daily operational support for MLOps platforms, ensuring high availability (99.9%+ SLA), cluster stability, and rapid incident resolution.
  • Build and maintain automated CI/CD workflows (GitHub Actions, GitLab CI, Bitbucket, Jenkins, AWS CodePipeline, ArgoCD) for model testing, containerization, feature store syncing, and release management.
  • Provision multi-tenant enterprise infrastructure using Terraform, AWS CloudFormation/CDK, and Helm on Kubernetes (EKS).
  • Configure telemetry (AWS CloudWatch, Prometheus, Grafana) for GPU tracking, latency SLAs, token costs, and data/model drift monitoring.

Experience & Background

• Education: Bachelor’s, Master’s, or Ph.D. in Computer Science, Data Science, Artificial Intelligence, or a quantitative discipline.
• Work Experience:
  • AVP Level (4+ years): Hands‑on experience building LLM applications, microservices, containerized AWS deployments (EKS/Docker), and managing daily MLOps operations, have experience to drive a project from 0 -1.
  • VP Level (8+ years): Demonstrated track record architecting production AI platforms, LLM serving stacks, and multi‑agent harnesses at enterprise scale, while leading platform engineering practices, have team leading experience.

Technical Skills

• AWS Cloud & AI Services: Core experience with Amazon Bedrock, SageMaker AI, EKS, EC2 GPU instances, S3, IAM, CloudWatch, and PrivateLink.
• Languages & Core AI Frameworks: Strong proficiency in Python. Deep hands‑on experience with LangChain/LangGraph and LlamaIndex.
• Agentic Frameworks & Protocols: Practical experience with agentic workflows and protocol standards like MCP and Agent-to-Agent (A2A).
• Inference Stack & Compute: Proficiency with vLLM, TensorRT-LLM, Triton, Ray, MLflow, GPU memory management, and quantization techniques.
• DevOps & Infrastructure: Hands‑on experience with Docker, Kubernetes (EKS), Terraform, Helm, Git, and GitOps tools (ArgoCD).
• Operational Mindset: Strong diagnostic skills for troubleshooting pipeline bottlenecks, container crashes, drift anomalies, and platform incidents.

What we offer:

• Competitive base salary.
• A suite of holistic, flexible benefits to suit every lifestyle.
• Community initiatives.
• Industry‑leading learning and professional development opportunities.
• Your wellbeing, growth and aspirations are every bit as cared for as the needs of our customers.
• Let’s build the bank we need for the future we want.
• Find the best version of yourself in a friendly, supportive team.
• Build lasting value in your community.
• Help people grow their assets, business, and investments.
• Take your learning as far as you can.
• Or simply enjoy a vibrant, future‑ready career.
• Your Opportunity Starts Here

As the longest established Singapore bank, formed in 1932 from the merger of three local banks, we have grown from strength to strength to become a regional financial services group. With a deep history in Asia, we offer the most comprehensive coverage across ASEAN and Greater China, complemented with a presence in the leading economies of New York, London and Sydney. We are the second largest financial services group in Southeast Asia by assets with one of the world’s highest credit rating (Aa1 by Moody’s and AA- by both Fitch and S&P). We offer private banking services through our wholly‑owned subsidiary, Bank of Singapore, which operates on a unique open‑architecture product platform to source for the best‑in‑class products to meet its clients’ goals. Our insurance subsidiary, Great Eastern Holdings, is the oldest and most established life insurance group in Singapore and Malaysia.