Data Lakehouse Architect

R SYSTEMS (SINGAPORE) PTE LIMITED; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

R SYSTEMS (SINGAPORE) PTE LIMITED is seeking an experienced data lakehouse architect to own the end-to-end architecture of the lakehouse platform. You will design data products, a data marketplace, and a knowledge layer, enabling agentic workloads to run on the platform.

You will ensure QA of the team’s deliveries per Bank-defined software delivery methodologies and collaborate with other technology functions to deliver required technology solutions.

Qualifications

• 10+ years of experience implementing a Data Lakehouse in FSI domains.
• Expertise with modern lakehouse fabrics (Iceberg/Hudi/Delta Lake).
• Strong knowledge of cloud platforms and distributed compute.

Responsibilities

• Own end-to-end architecture of the lakehouse platform.
• Design data products, data marketplace, and knowledge layer.
• Ensure QA of team deliveries per bank-defined methodologies.
• Partner with technology groups to deliver solutions.
• Create roadmaps and target architectures for platforms.

Skills

Data Lakehouse design

Databricks/Snowflake

MPP & distributed compute

Kubernetes/DevOps

Cloud platforms

Tools

Databricks

Snowflake

Kubernetes

Iceberg/Hudi/Delta Lake

Job description

Responsibilities:

• You will be responsible for the end-to-endarchitecture of thelakehouseplatform.
• This includes the design and implementation ofdataproducts,datamarketplace, knowledge layer and enabling agentic workloads to run out of thelakehouseplatform.
• You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools.
• You will partner with other technology functions to help deliver required technology solutions.

Other responsibilities include:

• Provide technical vision and create roadmaps for thelakehouseplatform.
• Create the targetarchitecture for an application / set of applications with emphasis on platforms, reusability, scalability and security.
• Create frameworks, technical features which helps in faster operationalization of new patterns such as unstructured content extraction, lambdaarchitecture deployment patterns, retrieval-augmenteddatapatterns, agentic workloads etc.
• Effectively partner with business users to designdatacontracts, SLA,dataquality rules fordataproducts.
• Independently install, customize and integrate software packages and programs.
• Participate in selection of product/tools via RFP/POC.
• Create technical documents (functional/non-functional specification, design specification, training manual) for the solutions. Review design specifications created by development team.

Requirement:

• 10+ years of experience of implementing a Data Lakehouse preferably in FSI domain (using platforms such as Databricks, Snowflake, Cloudera, Huawei, Alibaba, Google Cloud, AWS, Azure)
• Experience in large scale implementations and performance optimizations in the Lakehouse using a. Open Table Formats such as Iceberg, Hudi, Delta Lake,
  b. Object Storage including tiered storage (hot, warm, cold data) strategies
  c. Data Federation such as Trino, Denodo, Dremio d. Multi modal Query Engines (Hive, Impala, Apache Kudu etc)
• Experience in designing MPP and Distributed Compute workloads across on-premise, hybrid and cloud environments.
• Experience in serving agentic workloads using RAG, Embedding strategies, Vector DB, Graph DB, prompt engineering, context management etc.
• Experience in designing optimal hybrid and cloud workloads using private dedicated connectivity (Direct Connect, Express Route etc), workload placement strategy, egress cost optimization, Infrastructure-as-Code.
• Experience in building foundation and business data products and serving them to downstream applications via API, pub-and-sub, generative BI, real-time dashboards, etc and publishing to a data marketplace.
• Knowledge of migrating workloads out of MPP appliances such as Teradata, Greenplum, Netezza using bulk migration strategies, agentic accelerators is a plus.
• Knowledge of containerization, deploying applications to Kubernetes, Openshift using Helm package manager, Kustomize etc is a plus.
• Expertise in integrating applications with Devops too.