Senior AI Data Engineer — GenAI & Data Platform Lead

Singtel Group; Singapore; On-site; SGD 120,000 - 170,000; Full time

Job summary

Singtel invites experienced AI Data Engineers to register interest for opportunities within the AIDA team. The role focuses on designing, building, and operating scalable data ingestion, transformation, and serving pipelines across a hybrid cloud data platform.

You will work with Databricks, Kafka, PySpark, and SQL to enable analytics, reporting, and machine learning applications, while ensuring governance and security compliance.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery.
• Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines.
• Hands-on experience with Python and SQL for data transformation and validation.
• Familiarity with Apache Spark (PySpark) and large-scale data processing concepts.
• Experience with implementing knowledge base and RAG solutions for agentic AI use cases.
• Strong communication and ability to lead technical discussions with stakeholders.

Responsibilities

• Design, build, and operate scalable data ingestion, transformation, and serving capabilities across a modern hybrid cloud data platform.
• Develop and optimize batch and streaming pipelines using Databricks and Kafka.
• Contribute to reliable, secure data for analytics, reporting, and ML use cases.
• Lead implementation of knowledge base and retrieval-augmented generation solutions for GenAI use cases.
• Ensure pipelines align with enterprise data architecture, governance, and security standards.
• Monitor data workflows for quality, observability, and reliability.
• Guide engineers and partners on data platform patterns and production readiness.
• Integrate data from diverse sources (files, APIs, databases, streaming) and define ingestion patterns.

Skills

Python

SQL

PySpark

Databricks

Kafka

Data pipelines

Cloud platforms

CI/CD

Data governance

Education

Bachelor's degree in CS/Engineering

Tools

Delta Lake

Databricks

Apache Spark

Job description

Singtel invites experienced AI Data Engineers to register interest for opportunities within the AIDA team. The role focuses on designing, building, and operating scalable data ingestion, transformation, and serving pipelines across a hybrid cloud data platform.

You will work with Databricks, Kafka, PySpark, and SQL to enable analytics, reporting, and machine learning applications, while ensuring governance and security compliance.