Senior Data Engineer – Spark Streaming & ML Pipelines

Newbridge; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A leading data engineering company in Singapore is seeking an experienced Data Engineer to design, build, and maintain data pipelines for analytics and machine learning. This role involves collaborating with cross-functional teams to create scalable data assets and optimize large-scale data processing. The ideal candidate has over 5 years of experience in data engineering, with deep expertise in Apache Spark and cloud platforms. Competitive salary and benefits offered.

Qualifications

• 5+ years of production grade data engineering experience.
• Deep expertise with Apache Spark, Kafka, distributed processing.
• Hands-on ML pipeline experience including feature engineering, model training, deployment.

Responsibilities

• Architect end to end batch and Spark Streaming pipelines on cloud.
• Implement ML feature pipelines and real-time inference services.
• Optimize peta byte scale processing with Spark, Kafka, and Flink.
• Build and maintain data warehouses/lakes.
• Enforce data quality, governance, and security.
• Develop CI/CD, monitoring, and alerting for pipelines.
• Mentor engineers and drive best practice documentation.

Skills

Apache Spark (batch & streaming)

Kafka

Machine Learning

SQL

Python

Scala

Tools

AWS

GCP

Azure

Redshift

BigQuery

Snowflake

Job description

A leading data engineering company in Singapore is seeking an experienced Data Engineer to design, build, and maintain data pipelines for analytics and machine learning. This role involves collaborating with cross-functional teams to create scalable data assets and optimize large-scale data processing. The ideal candidate has over 5 years of experience in data engineering, with deep expertise in Apache Spark and cloud platforms. Competitive salary and benefits offered.