Data Engineer

Unison Consulting Pte Ltd; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A leading consulting firm in Singapore is seeking a seasoned Data Engineer with at least 6 years of experience. The ideal candidate will have strong expertise in Hadoop and Spark, with proficiency in programming languages such as Python or Scala. Experience with containerization platforms like OpenShift and orchestration using Kubernetes is advantageous. Familiarity with DevOps practices and CI/CD pipelines will also be beneficial, making this an exciting opportunity to be part of innovative data projects.

Qualifications

• At least 6 years of experience as a Data Engineer.
• Strong expertise in designing and developing data infrastructure.
• Proficiency in Spark, Python, Scala, or Java needed.

Skills

Data processing technologies

Hadoop

Spark

Python

Scala

Java

Containerization (OpenShift)

Kubernetes

DevOps practices

CI/CD pipelines

Tools

Docker

Jenkins

Ansible

BitBucket

Control-m

Graphana

Prometheus

Splunk

Quantexa

Job description

𝐉𝐨𝐩 𝐃𝐞𝐬𝐜𝐫𝐞𝐏𝐓𝐈𝐎𝐍:

• At least 6 years of experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments
• Experience with Graphana, Prometheus, Splunk will be an added benefit
• Quantexa exposure and/or certification a strong plus
• Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Pig, etc)
• Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes
• Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java
• Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
• Experience with jobs schedulers like Control-m