Data Engineering Lead: Scale Data Lakes & AI Platform

DT One group.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

DT One is seeking a data engineer lead in Singapore or Manila to design, build, and maintain a scalable data and AI platform. You will collaborate with engineering leads, data scientists, and analysts to solve operational challenges and enable organizational growth.

The role emphasizes data quality, security, and scalable ML/AI deployments, including vector databases and LLM orchestration. You will drive data governance and platform adoption across teams.

Qualifications

• Expertise in medium- to large-scale data processing systems.
• Developers with strong Python/Java/Scala skills and SQL prowess.
• Experience with AWS services and Docker environments.
• Hands-on with distributed processing (Spark, Presto, Hadoop).
• Solid background in Data Warehousing and Data Modeling.
• Familiar with MLOps, LLM orchestration, and vector databases.

Responsibilities

• Design and build a reliable data lake at scale with data quality and availability.
• Build complex data pipelines adding new sources and capabilities.
• Develop internal tools, libraries, ETL automation, and data exploration frameworks.
• Migrate ML and Data Apps from POC to production with high availability and security.
• Architect and scale infrastructure for Generative AI and vector retrieval (RAG).
• Monitor ETLs, Data Warehouses, and Data Apps.
• Provide guidance on data governance and best practices.
• Support cross-functional teams on data usage and platform adoption.

Skills

Large-scale data processing

Python/Java/Scala

SQL & DB administration

AWS & Docker

Spark/Presto/Hadoop

Data Warehousing & Modeling

MLOps / LangChain / LlamaIndex

Vector databases (Pinecone/Milvus/Qdr)

Tools

Docker

AWS

LangChain

Job description

DT One is seeking a data engineer lead in Singapore or Manila to design, build, and maintain a scalable data and AI platform. You will collaborate with engineering leads, data scientists, and analysts to solve operational challenges and enable organizational growth.

The role emphasizes data quality, security, and scalable ML/AI deployments, including vector databases and LLM orchestration. You will drive data governance and platform adoption across teams.