Senior Data Architect - Databricks / Data Lakehouse / GenAI

D L RESOURCES PTE LTD

Singapore

Sur place

SGD 120 000 - 180 000

Plein temps

Il y a 4 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

D L Resources PTE LTD is seeking an experienced Senior Data Lakehouse Architect to lead the design and evolution of an enterprise Lakehouse platform for a banking-sector client in Singapore. The role focuses on defining technical vision, target architecture, and engineering standards across data products, data marketplace, knowledge layers, real-time processing, Generative AI, and agentic workloads.

You will drive reusable patterns, SLAs, governance, and security while collaborating with

Qualifications

  • 10–15 years of experience in enterprise Data Engineering, Big Data, Data Architecture, Data Lake, or Lakehouse implementations.
  • Strong experience designing and delivering large-scale Data Lakehouse platforms, preferably in banking, financial services, or regulated industries.
  • Experience with leading data and cloud platforms such as Databricks, Snowflake, Cloudera, Azure, AWS, GCP, Huawei Cloud, or Alibaba Cloud.
  • Experience designing distributed compute and MPP workloads across on-premise, hybrid, and cloud environments.
  • Deep understanding of enterprise data architecture, scalability, resilience, security, governance, and performance optimization.

Responsabilités

  • Own the end-to-end architecture and technical roadmap for the enterprise Data Lakehouse platform.
  • Design and evolve platform capabilities: data products, data marketplace, knowledge layers, real-time data processing, GenAI, vector search, and agentic workloads.
  • Define target architectures prioritizing reusability, scalability, resilience, security, and operational efficiency.
  • Develop reusable architecture patterns, frameworks, and accelerators for data extraction, batch/streaming, Lambda and event-driven architectures, RAG, and AI-driven data processing.
  • Partner with stakeholders to define data contracts, SLAs, data quality standards, and governance for enterprise data products.
  • Provide architecture oversight to ensure compliance with engineering, security, and delivery standards.
  • Review designs, specs, non-functional requirements, and implementation approaches.
  • Lead technology/product evaluations, PoCs, and RFP processes; guide installation, integration, and operation of platforms.
  • Lead performance engineering, capacity planning, scalability reviews, and optimization of distributed data workloads.
  • Collaborate with infrastructure, security, cloud, AI/ML, and operations teams to deliver integrated solutions.
  • Drive continuous service improvement, automation, platform standardization, and operational excellence.
  • Produce architecture docs, solution designs, implementation guidelines, and technical runbooks.

Connaissances

Data Lakehouse
Enterprise Architecture
Data Governance
Performance Tuning
Cloud Hybrid
Generative AI
RAG

Outils

Databricks
Snowflake
Azure
AWS
GCP
Spark
Flink

Description du poste

Senior Data Lakehouse Architect

Client: Bank Sector Client

About the Role

D L Resources is supporting a leading banking-sector client in hiring an experienced Senior Data Lakehouse Architect to lead the end-to-end architecture, design, and evolution of an enterprise Lakehouse platform.

The role will be responsible for defining the technical vision, target architecture, and engineering standards for modern data platforms, including data products, data marketplace, knowledge layers, real-time data processing, Generative AI, RAG, vector search, graph technologies, and agentic workloads.

The successful candidate should bring deep experience in large-scale enterprise data architecture, distributed computing, cloud and hybrid platforms, performance engineering, data governance, and modern DevSecOps practices.

Key Responsibilities
  • Own the end-to-end architecture and technical roadmap for the enterprise Data Lakehouse platform.

  • Design and evolve platform capabilities supporting:

    • Data products and data marketplace

    • Knowledge and semantic layers

    • Structured, semi-structured, and unstructured data

    • Real-time and streaming workloads

    • RAG and Generative AI use cases

    • Vector and graph-based data services

    • Agentic AI and autonomous workflow patterns

  • Define target architectures for applications and platform services with a focus on reusability, scalability, resilience, security, and operational efficiency.

  • Develop reusable architecture patterns, frameworks, and technical accelerators for:

    • Unstructured and multimodal content extraction

    • Batch and streaming architectures

    • Lambda and event-driven architectures

    • Retrieval-Augmented Generation (RAG)

    • Agentic workloads and AI-driven data processing

  • Partner with business and technology stakeholders to define data contracts, SLAs, data quality standards, and governance requirements for enterprise data products.

  • Provide architecture oversight and quality assurance to ensure solutions comply with the client’s software engineering, security, and delivery standards.

  • Review solution designs, technical specifications, non-functional requirements, and implementation approaches produced by engineering teams.

  • Participate in technology and product evaluations, proof-of-concepts, and RFP processes.

  • Guide installation, customization, integration, and operationalization of enterprise software platforms and technologies.

  • Lead performance engineering, capacity planning, scalability reviews, and optimization of distributed data workloads.

  • Partner with infrastructure, security, application, cloud, AI/ML, and operations teams to deliver integrated technology solutions.

  • Drive continuous service improvement, engineering automation, platform standardization, and operational excellence.

  • Produce architecture documentation, solution designs, implementation guidelines, operational standards, and technical runbooks.

Required Experience
  • 10–15 years of experience in enterprise Data Engineering, Big Data, Data Architecture, Data Lake, or Lakehouse implementations.

  • Strong experience designing and delivering large-scale Data Lakehouse platforms, preferably within banking, financial services, or another highly regulated industry.

  • Proven experience across one or more leading data and cloud platforms such as:
    Databricks, Snowflake, Cloudera, Azure, AWS, Google Cloud Platform, Huawei Cloud, or Alibaba Cloud.

  • Strong experience designing distributed compute and MPP workloads across on-premise, hybrid, and cloud environments.

  • Deep understanding of enterprise data architecture, scalability, resilience, security, governance, and performance optimization.

Core Lakehouse & Data Architecture Skills

Strong experience in several of the following areas:

  • Open Table Formats: Apache Iceberg, Apache Hudi, Delta Lake

  • Object Storage: Cloud and enterprise object storage, including hot/warm/cold tiering strategies

  • Data Federation: Trino, Denodo, Dremio

  • Distributed Query Technologies: Hive, Impala, Apache Kudu and similar platforms

  • Data Processing: Spark, PySpark, SQL, Java, Python, Scala

  • Real-Time & Streaming: Apache Kafka, Confluent, Azure Event Hubs, Amazon Kinesis, Apache Flink, Spark Streaming, Structured Streaming, Apache NiFi

  • Workflow & Scheduling: Airflow, Control‑M

  • Data Modelling & Governance: Enterprise data modelling, metadata, lineage, data contracts, data quality, and governance frameworks

Generative AI, RAG & Agentic Architecture

Experience designing or supporting modern AI-enabled data architectures, including:

  • Retrieval-Augmented Generation (RAG)

  • Embedding strategies and vectorization

  • Vector databases and vector search

  • Graph databases and knowledge graphs

  • Prompt and context management

  • Agentic workflow orchestration

  • Knowledge and semantic layers

  • AI-driven analytics and Generative BI

Relevant technologies may include:

Vector Search / Vector Databases

  • Databricks Vector Search

  • Azure AI Search

  • Pinecone

  • ChromaDB

  • Weaviate

  • Snowflake Cortex

Graph Databases

  • Neo4j

  • JanusGraph

  • TigerGraph

  • Microsoft Fabric / Cosmos DB

  • Amazon Neptune

  • Stardog

Agentic & AI Orchestration Frameworks

  • LangGraph

  • OpenAI Agents SDK

  • Microsoft Agent Framework

  • LlamaIndex Workflows

  • Google Agent Development Kit (ADK)

Data Products & Data Marketplace
  • Experience designing and delivering foundation and business data products.

  • Experience defining and implementing data contracts, service levels, governance, and quality controls.

  • Ability to expose data products through:

    • APIs

    • Publish/subscribe and event-driven architectures

    • Real-time dashboards

    • BI and Generative BI platforms

    • Data marketplace capabilities

  • Experience designing data products for enterprise consumption, reuse, discoverability, and governance.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Head of Engineering
Head of Engineering

Newbridge Alliance Pte Ltd • Singapore

Sur place
SGD 200 000 - 320 000
Data Platform Engineer
Data Platform Engineer

GECO Asia Pte Ltd • Singapore

Sur place
SGD 150 000 - 210 000
Senior Databricks Solution Architect
Senior Databricks Solution Architect

Unison Group • Singapore

Sur place
SGD 180 000 - 280 000
Senior Databricks Lakehouse Architect | Spark & Delta Lake
Senior Databricks Lakehouse Architect | Spark & Delta Lake

Unison Group • Singapore

Sur place
SGD 180 000 - 280 000
Senior Banking Data Architect: DW/Lakehouse & Data Mesh
Senior Banking Data Architect: DW/Lakehouse & Data Mesh

Unison Group • Singapore

Sur place
SGD 180 000 - 260 000
Senior Data Engineer
Senior Data Engineer

optimum solutions (singapore) pte ltd • Singapore

Sur place
SGD 120 000 - 180 000
Chief Architect - Data Engineering (Databricks Practice)
Chief Architect - Data Engineering (Databricks Practice)

Unison Group • Singapore

Sur place
SGD 180 000 - 300 000
Senior Data Engineer - Government Project
Senior Data Engineer - Government Project

NTT SINGAPORE PTE. LTD. • Singapore

Sur place
SGD 120 000 - 180 000
Lead Data Architect - Databricks Lakehouse
Lead Data Architect - Databricks Lakehouse

Unison Group • Singapore

Sur place
SGD 180 000 - 300 000
Solution Architect
Solution Architect

Riskdata Consulting • Singapore

Sur place
SGD 120 000 - 180 000