Senior AI Data Engineer: GenAI & Data Platform Lead

Singtel Group; Singapore; On-site; Confidential; Full time

Job summary

Singtel Group is seeking a senior data engineer to design, build, and run scalable batch and streaming pipelines across a hybrid cloud data platform in Singapore. You will ensure reliability, security, and alignment with governance standards while enabling analytics, reporting, and ML use cases.

You will lead data ingestion from diverse sources, perform transformations with PySpark/SQL, and own production readiness including observability, incident response, and CI/CD practices within a

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5-8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery.
• Proven ability to design, build, optimise, and operate production-grade data pipelines.

Responsibilities

• Design, build, optimise, and maintain batch and streaming data ingestion pipelines.
• Perform data transformation and cleansing using PySpark or SQL.
• Monitor and troubleshoot data workflows to ensure data quality and pipeline reliability.
• Provide technical guidance to engineers and delivery partners on data platform patterns and production readiness.
• Lead integration of data from diverse source systems (files, APIs, databases, streaming platforms).
• Maintain metadata and pipeline documentation for transparency and traceability.
• Own production readiness for assigned data and AI platform components, including observability and incident triage.
• Integrate pipelines with tools like Microsoft Fabric, Databricks, Delta Lake.

Skills

Batch and streaming pipelines

Python

SQL

PySpark

Databricks

Kafka

Data governance

CI/CD

Observability

Security

Enterprise data architecture

Production support

Knowledge base / RAG

Education

Bachelor's degree in Computer Science or Engineering

Tools

Databricks

Kafka

PySpark

SQL

Microsoft Fabric

Delta Lake

Job description

Singtel Group is seeking a senior data engineer to design, build, and run scalable batch and streaming pipelines across a hybrid cloud data platform in Singapore. You will ensure reliability, security, and alignment with governance standards while enabling analytics, reporting, and ML use cases.

You will lead data ingestion from diverse sources, perform transformations with PySpark/SQL, and own production readiness including observability, incident response, and CI/CD practices within a