Senior Data Engineer - AI-First Data Pipelines & Platforms

Singtel; Singapore; On-site; Confidential; Full time

Job summary

Singtel is seeking an experienced Senior Data Engineer to design and optimize data pipelines on a Big Data platform, enabling streaming and batch processing. You will build data apps and dashboards, integrate frontend with backend services, and conduct PoCs for new data solutions.

The role requires 5+ years of hands-on experience with Hadoop-like ecosystems, Python, Spark, and Airflow, plus data security and collaboration with cross-functional teams. Singapore-based, full-time.

Qualifications

• Bachelor's degree in Computer Science, Math, Data Analytics or related field.
• 5+ years hands-on development experience.
• Knowledge in Big Data platforms (Hadoop, mapR, Cloudera, HPE).
• Proficiency in Python, PySpark, SQL, NoSQL, kSQL; Linux shell scripting.
• Experience with data APIs (Spring Boot, Flask) and web development.
• Experience with Open Source like Apache Airflow and Zeppelin Notebook.
• Basic MS Office skills (Excel/Word/PowerPoint).
• Strong communication and collaboration with technical and non-technical teams.

Responsibilities

• Develop new and improve existing data pipelines on Big Data platforms.
• Build data applications for streaming and batch datasets.
• Work on Airflow with Python, Spark, PySpark, Scala, Java, SQL.
• Develop frontend dashboards and backend integrations using React/Angular/Django/FastAPI/Springboot.
• Perform R&D and PoC for new data solutions.
• Manage metadata and data security.
• Drive data quality and efficiency in data lake and streaming platforms.
• Lead and mentor Junior Data Engineers; oversee DevOps/DataOps in Data Engineering.

Skills

Data engineering

Big Data

Python

PySpark

SQL

NoSQL

KSQL

REST APIs

Airflow

Open Source

Spark

React

Angular

Django

Spring Boot

Flask

Linux shell

Data security

DevOps

Education

Bachelor's degree in Computer Science, Math, Data Analytics or related field

Tools

Hadoop

mapR

Cloudera

HPE

Apache Airflow

Zeppelin Notebook

Spring Boot

Flask

React

Angular

Django

FastAPI

Spark

PySpark

SQL

Job description

Singtel is seeking an experienced Senior Data Engineer to design and optimize data pipelines on a Big Data platform, enabling streaming and batch processing. You will build data apps and dashboards, integrate frontend with backend services, and conduct PoCs for new data solutions.

The role requires 5+ years of hands-on experience with Hadoop-like ecosystems, Python, Spark, and Airflow, plus data security and collaboration with cross-functional teams. Singapore-based, full-time.