Senior Data Engineering Consultant: Real-Time Pipelines & AI

re-zoo-me; Singapore; On-site; SGD 120,000 - 190,000; Full time

Job summary

re-zoo-me is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Spark/PySpark and cloud technologies. You will work closely with architects, data scientists and engineers to deliver robust data processing solutions.

The role requires 8+ years in data engineering, strong Python/Java/Scala skills, and experience with Spark, Hadoop, Hive and AWS. Familiarity with data lakes, warehouses and AI tooling is a plus.

Qualifications

• 8+ years in Data Engineering / Big Data environments.
• Strong programming in Python, Java and/or Scala.
• Hands-on Spark/Hadoop/Hive experience and data pipeline design.
• Cloud experience, especially AWS, and data warehousing skills.

Responsibilities

• Design, build and optimize scalable batch/real-time data pipelines.
• Develop ETL/ELT processes for large-scale data workflows.
• Create data ingestion solutions via databases, APIs, files and streaming.
• Implement CI/CD for data apps and support containerized deployments.
• Collaborate with architects, data scientists and stakeholders to deliver production-ready solutions.
• Explore Generative AI/NLP integrations and AI APIs where applicable.

Education

Bachelor's/Master's in CS/IT/Engineering

Tools

Spark/PySpark

Hadoop

Hive

Kafka

Airflow

Docker

Kubernetes

OpenShift

Databricks

Snowflake

Cloudera

AWS

LangChain

Job description

re-zoo-me is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Spark/PySpark and cloud technologies. You will work closely with architects, data scientists and engineers to deliver robust data processing solutions.

The role requires 8+ years in data engineering, strong Python/Java/Scala skills, and experience with Spark, Hadoop, Hive and AWS. Familiarity with data lakes, warehouses and AI tooling is a plus.