Senior Data Engineer – Spark, Flink & Kafka on Kubernetes

Singapore Technologies Engineering Ltd

Singapore

Presencial

SGD 120.000 - 180.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

ST Engineering is seeking a Senior Data Engineer in Singapore to design and build batch and streaming data pipelines. You will integrate Spark, Flink and Kafka with Java/Scala processing, and manage data quality, schemas and lineage across processing stages.

You will deploy workloads on Kubernetes, implement CI/CD practices with GitLab, and ensure high availability through checkpointing and disaster recovery. A strong background in S3-compatible storage is required.

Formación

  • 5–8 years of data engineering experience building large-scale data systems.
  • Hands-on design of batch and streaming pipelines with Spark, Flink and Kafka.
  • Proficient in Java or Scala and SQL for distributed processing.
  • Experience deploying and scaling data workloads in Kubernetes.
  • Familiarity with S3-compatible storage, data quality and lineage management.

Responsabilidades

  • Design, develop and maintain ingestion, transformation and validation pipelines using Spark, Flink and Kafka.
  • Implement distributed processing in Java or Scala with SQL and S3-compatible storage.
  • Maintain schemas, metadata, lineage and data-quality controls across stages.
  • Deploy and scale workloads on Kubernetes; enable CI/CD, monitoring, and troubleshooting.
  • Ensure high availability with checkpointing, recovery, retention and inter-site sync.

Conocimientos

Data engineering
Distributed processing
SQL proficiency
Cloud concepts

Herramientas

Apache Spark
Apache Flink
Apache Kafka
Java
Scala
Kubernetes
S3-compatible storage

Descripción del empleo

ST Engineering is seeking a Senior Data Engineer in Singapore to design and build batch and streaming data pipelines. You will integrate Spark, Flink and Kafka with Java/Scala processing, and manage data quality, schemas and lineage across processing stages.

You will deploy workloads on Kubernetes, implement CI/CD practices with GitLab, and ensure high availability through checkpointing and disaster recovery. A strong background in S3-compatible storage is required.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer — Spark, Flink & Kafka on Kubernetes
Senior Data Engineer — Spark, Flink & Kafka on Kubernetes

ST Engineering Mission Software & Services Pte Ltd • Singapore

Presencial
SGD 120.000 - 180.000
Competitive remuneration
Comprehensive benefits
Senior Data Engineer: Spark/Flink/Kafka on Kubernetes
Senior Data Engineer: Spark/Flink/Kafka on Kubernetes

ST Engineering Group • Singapore

Presencial
SGD 120.000 - 180.000
Competitive remuneration
Comprehensive benefits
Senior Data Engineer: Spark, Kafka, Kubernetes
Senior Data Engineer: Spark, Kafka, Kubernetes

dci consultants private limited • Singapore

Presencial
SGD 90.000 - 130.000
Senior Data Engineer: Real-Time Pipelines on Kubernetes
Senior Data Engineer: Real-Time Pipelines on Kubernetes

Beyondsoft Singapore • Singapore

Presencial
SGD 120.000 - 180.000
Senior Data Engineer: Real-Time Pipelines & Spark
Senior Data Engineer: Real-Time Pipelines & Spark

hyperscal solutions pte. ltd. • Singapore

Presencial
SGD 90.000 - 140.000
Senior Backend Engineer - Data & Streaming
Senior Backend Engineer - Data & Streaming

dci consultants private limited • Singapore

Presencial
SGD 120.000 - 180.000
Junior Data Engineer: Spark, Kafka & ETL Pipelines
Junior Data Engineer: Spark, Kafka & ETL Pipelines

INNOVATIQ SOLUTIONS PTE. LTD. • Singapore

Presencial
SGD 90.000 - 130.000
Senior Data Engineer – Real-Time Pipelines, Spark & Kafka
Senior Data Engineer – Real-Time Pipelines, Spark & Kafka

talentsis pte. ltd. • Singapore

Presencial
SGD 120.000 - 180.000
Senior Data Systems Engineer - Spark/Kafka on Kubernetes
Senior Data Systems Engineer - Spark/Kafka on Kubernetes

talentsis pte. ltd. • Singapore

Presencial
SGD 120.000 - 180.000
Senior Data Engineer: Real-Time Pipelines, K8s & Quality
Senior Data Engineer: Real-Time Pipelines, K8s & Quality

Beyondsoft International (Singapore) Pte Ltd • Singapore

Presencial
SGD 120.000 - 180.000