Senior Data Engineer (Permanent)

talentsis pte. ltd.

Singapore

Presencial

SGD 120.000 - 180.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Talentsis pte. ltd. in Singapore seeks an experienced Senior Data Engineer to design, develop and maintain large-scale aviation data systems, building batch and real-time pipelines.

You will integrate multiple data sources, storage and recovery mechanisms, deploy on Kubernetes, and ensure data quality and governance across sites.

The role emphasizes GitLab CI/CD, monitoring, and disaster recovery with a focus on reliability and scalability.

Formación

  • 5–8 years of relevant experience in data engineering.
  • Experience designing and developing batch and streaming data pipelines.
  • Proficiency in Java or Scala for distributed data processing and SQL.
  • Experience deploying and scaling data workloads using Docker and Kubernetes.
  • Familiarity with S3-compatible object storage, data schemas, metadata management, data lineage and data quality controls.
  • Experience with checkpointing, fault recovery, data retention and disaster recovery mechanisms.
  • Hands-on experience with GitLab CI/CD pipelines, automated testing and monitoring.
  • Strong analytical, troubleshooting and problem-solving skills.

Responsabilidades

  • Design, develop and maintain batch and real-time data pipelines using Apache Spark, Apache Flink and Apache Kafka.
  • Implement distributed data processing solutions using Java or Scala and SQL.
  • Integrate multiple data sources and S3-compatible object storage for ingestion and processing.
  • Manage data schemas, metadata, lineage and data quality across pipelines.
  • Deploy, maintain and scale data workloads in Kubernetes environments.
  • Implement automated testing, GitLab CI/CD pipelines, monitoring and troubleshooting.
  • Establish checkpointing, recovery, data retention and lifecycle management.
  • Support high availability, backup, disaster recovery and data synchronization across sites.

Conocimientos

Spark
Flink
Kafka
Java
Scala
SQL
Docker
Kubernetes
GitLab CI/CD
Data quality & lineage

Herramientas

Apache Spark
Apache Flink
Apache Kafka
Java
Scala
SQL
Docker
Kubernetes
GitLab CI/CD

Descripción del empleo

About the Role

We are seeking an experienced Senior Data Engineer to design, develop and maintain large-scale data processing solutions for aviation systems. You will build reliable batch and real-time data pipelines, integrate multiple data sources and implement scalable data storage, processing and recovery mechanisms.

Key Responsibilities
  • Design, develop and maintain batch and real-time data pipelines using Apache Spark, Apache Flink and Apache Kafka.

  • Implement distributed data processing solutions using Java or Scala and SQL.

  • Integrate multiple data sources and S3-compatible object storage for data ingestion and processing.

  • Manage data schemas, metadata, lineage and data quality across processing pipelines.

  • Deploy, maintain and scale data processing workloads in Kubernetes environments.

  • Implement automated testing, GitLab CI/CD pipelines, monitoring and operational troubleshooting.

  • Establish checkpointing, recovery, data retention and lifecycle management mechanisms.

  • Support high availability, backup, disaster recovery and data synchronisation across multiple sites.

Requirements and Qualifications
  • 5–8 years of relevant experience in data engineering, distributed systems or large-scale data platform development.

  • Strong hands-on experience designing and developing batch and streaming data pipelines using Apache Spark, Apache Flink and Apache Kafka.

  • Proficiency in Java or Scala for distributed data processing, together with strong SQL skills.

  • Experience deploying and scaling data workloads using Docker and Kubernetes.

  • Familiarity with S3-compatible object storage, data schemas, metadata management, data lineage and data quality controls.

  • Experience with checkpointing, fault recovery, data retention and disaster recovery mechanisms.

  • Hands-on experience with GitLab, CI/CD pipelines, automated testing and monitoring.

  • Strong analytical, troubleshooting and problem-solving skills.

Only shortlisted candidates will be notified.

(EA Reg No: 20C0312)

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

[T04] Junior/Senior Data Engineer - Permanent Role
[T04] Junior/Senior Data Engineer - Permanent Role

TALENTSIS PTE. LTD. • Singapore

Presencial
SGD 90.000 - 120.000
Senior / Data Engineer [Permanent]
Senior / Data Engineer [Permanent]

TALENTSIS PTE. LTD. • Singapore

Presencial
SGD 70.000 - 110.000
Data Engineer
Data Engineer

PageGroup Corporation Solutions (Malaysia) Sdn Bhd • Singapore

Presencial
SGD 80.000 - 120.000
Senior Data Engineer
Senior Data Engineer

SCIENTE INTERNATIONAL PTE. LTD. • Singapore

Presencial
SGD 140.000 - 210.000
Senior Data Engineer – AWS / Databricks / PySpark
Senior Data Engineer – AWS / Databricks / PySpark

Astek Group • Singapore

Presencial
SGD 120.000 - 180.000
Senior Data Engineer – AWS / Databricks / PySpark
Senior Data Engineer – AWS / Databricks / PySpark

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. • Singapore

Presencial
SGD 120.000 - 180.000
Senior Data Engineer [20261042355]
Senior Data Engineer [20261042355]

Beyondsoft International (Singapore) Pte Ltd • Singapore

Presencial
SGD 120.000 - 180.000
21. Data Engineer (Senior) - KT
21. Data Engineer (Senior) - KT

dci consultants private limited • Singapore

Presencial
SGD 90.000 - 130.000
Senior Data Engineer (AWS & Databricks) | Contract
Senior Data Engineer (AWS & Databricks) | Contract

nexbridge recruitment pte. ltd. • Singapore

Presencial
SGD 90.000 - 180.000
Senior Data Engineer AWS / Databricks / PySpark
Senior Data Engineer AWS / Databricks / PySpark

astek singapore innovation technology pte. ltd. • Singapore

Presencial
SGD 120.000 - 190.000