Senior Data Engineer: AI-Driven Data Pipelines

Singtel Group; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

Singtel is seeking a Senior Data Engineer to build and enhance data pipelines on Big Data platforms and to develop data applications for streaming and batch workloads.

You will collaborate across business and technology teams, lead DevOps/DataOps efforts, and mentor junior engineers while applying data security and governance practices to deliver scalable solutions.

Join a multinational telco leader driving AI-enabled digital infrastructure, 5G, cloud and data-driven services across the globe.

Qualifications

• Bachelor's degree in Computer Science, Math, Data Analytics or related field.
• Knowledge of Big Data Platform such as Hadoop, mapR, Cloudera, HPE, etc.
• Hands-on programming experience in Python, PySpark, SQL, NoSQL; experience in Big Data apps and Linux shell scripting.
• Experience in Data API exposure (Spring Boot, Flask or equivalent) and web development.
• Experience with Open Source like Apache Airflow, Zeppelin Notebook for Data Exploratory Analysis.
• Basic knowledge in Microsoft Office tools.
• Able to communicate concepts clearly to technical and non-technical staff.
• Strong interpersonal skills, self-driven and fast learner; good technical writing.

Responsibilities

• Develop new and improve existing data pipelines on Big Data platforms (Hadoop, MapR, or equivalent).
• Build and enhance data applications for streaming and batch datasets.
• Work with Apache Airflow, Python, Spark, PySpark, Scala, Java, SQL and related tech stacks.
• Develop frontend dashboards and integrate with backend using frameworks like React, Angular, Django, FastAPI, Spring Boot.
• Perform R&D and PoC for new data solutions; ensure data security and metadata management.
• Drive data quality improvements and optimize data lake and streaming platforms.
• Lead and guide junior Data Engineers and oversee DevOps/DataOps and streaming operations.
• Design high-level and detailed designs aligned with analytics architecture principles and roadmap.
• Collaborate with business, technical, project management and operations stakeholders.

Skills

Python

PySpark

SQL

NoSQL

Data analytics

Big data architectures

Education

Bachelor's degree in Computer Science, Math, Data Analytics or related field

Tools

Hadoop

MapR

Cloudera

Spark

Airflow

Zeppelin

React

Angular

Django

FastAPI

Spring Boot

Linux shell scripting

Job description

Singtel is seeking a Senior Data Engineer to build and enhance data pipelines on Big Data platforms and to develop data applications for streaming and batch workloads.

You will collaborate across business and technology teams, lead DevOps/DataOps efforts, and mentor junior engineers while applying data security and governance practices to deliver scalable solutions.

Join a multinational telco leader driving AI-enabled digital infrastructure, 5G, cloud and data-driven services across the globe.