Senior Data Engineer: Real-Time Pipelines & AI-Driven Data

UARROW PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

UARROW PTE. LTD. seeks a Senior Data Engineer to design, develop and optimize scalable data solutions using Big Data, cloud and AI technologies in Singapore.

You will build high-performance data pipelines, ingestion frameworks and data processing systems, collaborating with architects, data scientists and engineers to deliver production-ready solutions. The role requires strong Python/Java/Scala skills, extensive Spark/PySpark experience, and hands-on AWS data services knowledge.

Qualifications

• Degree in computer science, information technology, or engineering.
• 8+ years in Data Engineering / Big Data with large-scale processing.
• Strong programming in Python, Java and/or Scala.
• Hands-on with Spark/PySpark, SQL, Hadoop and Hive.
• Experience with AWS and data warehousing / lake tech.
• Familiarity with Kafka, Airflow and CI/CD practices.

Responsibilities

• Design, develop and optimize scalable data pipelines (batch/real-time).
• Develop ETL/ELT processes for large-scale data processing.
• Build data ingestion using databases, APIs, files and streaming platforms.
• Work with AWS services: S3, Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB.
• Optimize data processing using Hadoop, Hive, Spark, Kafka, Cloudera, Databricks.
• Tune SQL and Spark performance for large workloads.
• Design data models, data warehouses and data lake solutions.
• Develop CI/CD pipelines; support Docker/Kubernetes/OpenShift deployments.
• Integrate Generative AI, NLP, LLMs, RAG, and vector databases where needed.
• Collaborate with architects, data scientists and engineers from conception to production.

Skills

Python

Java/Scala

SQL

Apache Spark

ETL/ELT design

Data processing

Education

Bachelor’s degree in CS/IT/Engineering

Master’s degree

Tools

Docker

Kubernetes

OpenShift

AWS

Databricks

Snowflake

Cloudera

Hadoop

Airflow

Jenkins

Git

CI/CD

Job description

UARROW PTE. LTD. seeks a Senior Data Engineer to design, develop and optimize scalable data solutions using Big Data, cloud and AI technologies in Singapore.

You will build high-performance data pipelines, ingestion frameworks and data processing systems, collaborating with architects, data scientists and engineers to deliver production-ready solutions. The role requires strong Python/Java/Scala skills, extensive Spark/PySpark experience, and hands-on AWS data services knowledge.