Software & Data Engineering Specialist

UARROW PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

UARROW PTE. LTD. in Singapore seeks a data engineering specialist to design and implement scalable data pipelines using PySpark, Spark, Hadoop, Hive and Kafka on cloud platforms.

The role requires hands-on work with Generative AI, LLM, RAG, vector databases, NLP, API development and containerised deployment with Docker, Kubernetes or OpenShift, plus strong Python/Java/Scala coding and CI/CD practices.

Qualifications

• Design and develop scalable data engineering solutions using PySpark, Spark, Hadoop, Hive, Kafka and cloud platforms.
• Hands-on experience in Generative AI, LLM, RAG, vector databases, NLP, API development and containerised deployment using Docker/Kubernetes/OpenShift.

Responsibilities

• Design and develop scalable data engineering solutions using PySpark, Spark, Hadoop, Hive, Kafka and cloud platforms.
• Hands-on experience in Generative AI, LLM, RAG, vector databases, NLP, API development and containerised deployment using Docker/Kubernetes/OpenShift.

Skills

PySpark

Python

Java

Scala

Spark

Hadoop

Hive

Kafka

Cloud platforms

API development

CI/CD

Production support

Generative AI

LLM

RAG

Vector databases

NLP

Tools

Docker

Kubernetes

OpenShift

Spark

Hadoop

Hive

Kafka

AWS data services

Job description

Responsible for designing and developing scalable data engineering solutions using PySpark, Spark, Hadoop, Hive, Kafka and cloud platforms. The role involves building complex batch and streaming ETL/ELT pipelines, data migration and optimisation, integrating AWS data services, and implementing data processing frameworks.

The role also requires hands-on experience in Generative AI, LLM, RAG, vector databases, NLP, API development and containerised deployment using Docker/Kubernetes/OpenShift. Candidates should have strong programming skills in Python, Java or Scala and experience with enterprise-scale data platforms, CI/CD and production support.