Senior AI Data Engineer: Lead GenAI & Data Pipelines

Singapore Telecommunications Limited; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Singtel invites a seasoned Data Platform Engineer to design, build, and operate scalable batch and streaming data pipelines. You will work on a modern cloud data platform, ensuring reliability, security, and governance across AI-enabled analytics, reporting, and knowledge-base applications.

You will own data ingestion, transformation, and integration from diverse sources, while applying best practices in CI/CD, observability, and production operations to support GenAI and enterprise analytics

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery.
• Proven ability to independently design, build, optimise, and operate production‑grade data pipelines.
• Hands‑on experience with Python and SQL for data transformation and validation.
• Familiarity with Apache Spark (PySpark) and large‑scale data processing concepts.
• Experience with knowledge base and RAG solutions for agentic AI use cases.
• Strong problem-solving skills and ability to lead technical discussions.

Responsibilities

• Design, build, optimise, and maintain batch and streaming data pipelines using Databricks and Kafka.
• Perform data transformation and cleansing using PySpark or SQL.
• Monitor and troubleshoot data workflows to ensure data quality and pipeline reliability.
• Provide technical guidance to engineers and delivery partners on platform patterns and best practices.
• Lead integration of data from diverse source systems and define ingestion patterns.
• Own production readiness, observability, incident triage, and runbook improvements.
• Integrate pipelines with Microsoft Fabric, Databricks, Delta Lake, and other components.
• Build and maintain knowledge base and RAG solutions across hosting platforms.

Skills

Python

SQL

PySpark

Apache Spark

Data pipelines

CI/CD

Observability

Data governance

Cloud platforms

Education

Bachelor’s degree in Computer Science, Engineering, or a related field

Tools

Databricks

Kafka

Delta Lake

Microsoft Fabric

Job description

Singtel invites a seasoned Data Platform Engineer to design, build, and operate scalable batch and streaming data pipelines. You will work on a modern cloud data platform, ensuring reliability, security, and governance across AI-enabled analytics, reporting, and knowledge-base applications.

You will own data ingestion, transformation, and integration from diverse sources, while applying best practices in CI/CD, observability, and production operations to support GenAI and enterprise analytics