Senior AI Data Engineer: Build Scalable GenAI Pipelines

Singtel Group; Singapore; On-site; SGD 110,000 - 170,000; Full time

Job summary

Singtel Group is seeking a Senior Data Platform Engineer to design, build, and run scalable data pipelines, enabling analytics and AI initiatives. You’ll work on batch and streaming workloads, leverage Databricks, Kafka, and PySpark, and contribute to governance and production readiness.

You will lead cross‑functional collaborations, implement knowledge base solutions for GenAI, and ensure secure, observable data platforms that scale with enterprise needs.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5–8 years of experience in data engineering or cloud-scale analytics delivery.
• Strong ability to design, build, and operate production-grade data pipelines.
• Proficient in Python and SQL for data transformation and validation.

Responsibilities

• Design, build, and operate scalable batch and streaming data pipelines on Databricks and Kafka.
• Ensure reliability, observability, and security across data platforms.
• Lead knowledge base development and RAG solutions for AI use cases across domains.
• Provide technical guidance to engineers and partners; define ingestion patterns and timelines.
• Maintain documentation, metadata, and production readiness for data/AI components.

Skills

Python

SQL

Databricks

Kafka

PySpark

Data pipelines

CI/CD

Data governance

Education

Bachelor's degree in CS/Engineering or related field

Tools

Databricks

Kafka

Delta Lake

PySpark

Microsoft Fabric

CI/CD tooling

Job description

Singtel Group is seeking a Senior Data Platform Engineer to design, build, and run scalable data pipelines, enabling analytics and AI initiatives. You’ll work on batch and streaming workloads, leverage Databricks, Kafka, and PySpark, and contribute to governance and production readiness.

You will lead cross‑functional collaborations, implement knowledge base solutions for GenAI, and ensure secure, observable data platforms that scale with enterprise needs.