Senior Data Engineer (Networks)

Singapore Telecommunications Limited; Singapore; On-site; SGD 90,000 - 180,000; Full time

Benefits offered by this job

Health and wellness benefits

Training and development programs

Internal mobility opportunities

Job summary

Singtel is expanding its data engineering team to deliver scalable data pipelines and analytics across its telecom platforms. The role focuses on building and improving data pipelines on Hadoop-like platforms, developing data applications for streaming and batch data, and integrating front-end dashboards with back-end services.

The ideal candidate will have a Bachelor's degree in a relevant field and at least 5 years of hands-on development experience with Big Data, Python, PySpark, SQL and

Qualifications

• Bachelor degree in Computer Science, Math, Data Analytics or related field.
• Hands-on development experience with 5+ years in data engineering or related role.
• Experience with Big Data platforms (Hadoop, MapR, Cloudera, etc.).
• Proficient in Python, PySpark, SQL and NoSQL.
• Experience exposing Data APIs and web development.

Responsibilities

• Develop new and improve existing data pipeline on Big Data platform (Hadoop, MapR or equivalent).
• Build and enhance data applications for streaming and batch datasets.
• Work on Apache Airflow for data pipelines; use Python, Spark, PySpark, SQL, etc.

Skills

Big Data

Python

PySpark

SQL

NoSQL

Linux shell scripting

Web development

Education

Bachelor degree in Computer Science, Math, Data Analytics or related field

Tools

Hadoop/MapR/Cloudera

Open Source: Apache Airflow/Zeppelin

Spring Boot / Flask

React / Angular / Django / FastAPI / Springboot

Job description

At Singtel, we believe in the strength of a vibrant, diverse and inclusive workforce where backgrounds, perspectives and life experiences of our people help us innovate and create strong connections with our customers. We strive to ensure all our people practices are non-discriminatory and provide a fair, performance-based work culture that is diverse, inclusive and collaborative.
Join us and experience what it’s like to be with an Employer of Choice*. Together, let’s create a brighter digital future for all. *Awarded at the HR Fest Awards 2020.

Singtel Networks, the most established telecommunications infrastructure provider in Singapore is transforming to enable the digital generation of tomorrow. We are introducing new capabilities in 5G, Cloud, Analytics, Digital Commerce, Software Engineering, Cyber Security to enhance our core competencies and deliver innovative and differentiated Mobile and Fixed services (Broadband, TV and Telephony) for our customers. We are committed to celebrating inclusion and diversity and is a strong believer to upskill and nurture all individuals. Come join us today as we build Singtel’s Networks of tomorrow, and Empower Every Generation to live, work and play in new ways!

Make an Impact by:

• Develop new and improve existing data pipeline on Big Data platform (Hadoop, mapR or equivalent).
• Build new and enhance existing data application for streaming and batch datasets.
• Work on Apache Airflow on data pipeline, Python, Spark, PySpark, Scala, Java, SQL, etc for data application open sources technologies.
• Responsible in developing frontend dashboards and integration to back end. Using frontend and backend API Frameworks such as React, Angular Django, FastAPI, Springboot.
• Perform R&D and conduct PoC (proof-of-concept) for new data solution.
• Perform metadata and data management, data security
• Drive optimization, testing and tooling to improve data quality & efficiency in data lake and streaming platform
• Lead and monitor the performance of Junior Data Engineer and providing them with practical guidance, solution validation and implementation.
• Lead and manage DevOps, DataOps and Streaming Operations (or equivalent) in Data Engineering
• Design high level & detailed design to ensure that the solution delivers to the business needs and align to the data & analytics architecture principles and roadmap.
• Collaborate with different stakeholders from business, technical, project management and operation to design and implement the solution.
• Ensure best practices, frameworks and re-useable components are employed in the development project.
• Ability to lead troubleshooting efforts for complex design and eliminate application issue faced by the project and operation team.
• Understand various data security standards, information security standard and to apply and adhere to the required data controls for user access.

Skills for Success:

• Bachelor degree in Computer Science, Math, Data Analytics or related field with at least 5 years of hands-on development experience.
• Knowledge in Big Data Platform such as Hadoop, mapR, Cloudera, HPE, etc.
• Hands-on experience in Programming language including Python, PysSpark, SQL, noSQL, kSQL.
• Prefer to have experience in Big Data application and Linux shell scripting.
• Experience in Data API exposure (Spring Boot, Flask or equivalent) and web development.
• Experience in Open Source like Apache Airflow, Zeppelin Notebook for Data Exploratory Analysis, etc
• Basic knowledge in Microsoft software e.g. Excel, Word and Power Points.

Rewards that Go Beyond

• Full suite of health and wellness benefits
• Ongoing training and development programs
• Internal mobility opportunities

Are you ready to say hello to BIG Possibilities? Take the leap with Singtel to unlock new opportunities and accelerate your growth.