Data Engineer – Lakehouse & Databricks Pipelines

NTT SINGAPORE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NTT Singapore PTE. LTD. invites applications for a Data Engineer to design, develop and operationalise enterprise-scale data platforms, Lakehouse solutions and data products.

The candidate will work with Databricks, Apache Spark, PySpark, Python and SQL to build scalable batch and streaming pipelines, implement data quality controls and support AI, GenAI use cases in a modern Lakehouse architecture.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology or a related discipline.

Responsibilities

• Design, develop and operationalise enterprise Data Lake, Lakehouse and data engineering platforms.
• Develop scalable batch, streaming, CDC and API-based data ingestion pipelines.
• Build and maintain data pipelines using Spark, PySpark, Python, SQL and related Big Data technologies.
• Develop reusable foundation and business data products, including data contracts, SLAs and data quality controls.
• Implement data ingestion, transformation, reconciliation and data quality frameworks.
• Work with modern Lakehouse and open table technologies such as Delta Lake, Iceberg and Hudi.
• Develop solutions for structured, semi-structured and unstructured data, including extraction and processing of content from different file formats.
• Work with streaming and distributed data technologies such as Kafka, Spark Streaming, Flink, Airflow, Hive, Trino or Dremio
• Design data architectures supporting AI, NLP, RAG, vector search and GenAI/agentic applications.
• Support ingestion, curation, governance and consumption of unstructured data for AI-driven analytics.
• Expose data through APIs, event streams, dashboards and other enterprise consumption channels.
• Perform performance tuning, troubleshooting, production support and root cause analysis.
• Implement automated deployment and engineering practices using Docker, Kubernetes/OpenShift and CI/CD pipelines.
• Work closely with architecture, engineering, analytics and business teams across multiple projects.
• Prepare technical documentation, deployment guides and operational runbooks.
• Ensure solutions comply with engineering standards, security requirements, DevSecOps controls and software delivery practices.

Skills

Data Engineering

Databricks

Apache Spark

PySpark

Python

SQL

ETL/ELT

Agile

Communication

Education

Bachelor's degree in Computer Science, Engineering, Information Technology

Tools

Databricks Platform

Snowflake

Cloudera

Azure

AWS

GCP

Kafka

Spark Streaming

Flink

Airflow

Hive

Trino

Dremio

Delta Lake

Iceberg

Hudi

Kubernetes

OpenShift

Docker

Jenkins

Git

CI/CD

Job description

NTT Singapore PTE. LTD. invites applications for a Data Engineer to design, develop and operationalise enterprise-scale data platforms, Lakehouse solutions and data products.

The candidate will work with Databricks, Apache Spark, PySpark, Python and SQL to build scalable batch and streaming pipelines, implement data quality controls and support AI, GenAI use cases in a modern Lakehouse architecture.