Data Engineer, Databricks & Cloud Pipelines

Singtel Group; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading technology services firm in Singapore is seeking an experienced Data Engineer responsible for designing, developing, and maintaining scalable data pipelines on cloud platforms like Databricks. The ideal candidate should have over 3 years of experience in data engineering, a strong understanding of data solutions, and hands-on skills with tools such as PySpark, Azure, and Airflow. They will collaborate with analytics and product teams to enhance data platforms while implementing best practices for data governance and monitoring.

Qualifications

• 3+ years of experience in data engineering with scalable pipelines.
• Strong experience designing data solutions, including data modelling.
• Hands-on experience with data processing jobs using PySpark and Spark SQL.

Responsibilities

• Develop and maintain ETL pipelines for centralized data storage systems.
• Integrate data from multiple sources including APIs and databases.
• Develop dashboards, reports, and data visualizations.

Skills

Data engineering with scalable pipelines

Data modelling

PySpark

Spark SQL

Azure

SQL

DevOps tools

Streaming technologies

Tools

Databricks

ADF

Airflow

Job description

A leading technology services firm in Singapore is seeking an experienced Data Engineer responsible for designing, developing, and maintaining scalable data pipelines on cloud platforms like Databricks. The ideal candidate should have over 3 years of experience in data engineering, a strong understanding of data solutions, and hands-on skills with tools such as PySpark, Azure, and Airflow. They will collaborate with analytics and product teams to enhance data platforms while implementing best practices for data governance and monitoring.