Data Scientist - AI & Big Data Architect

UARROW PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

UARROW PTE. LTD. in Singapore is seeking a highly skilled Data Engineer to design, build and maintain scalable data pipelines for large-scale datasets.

You will work with Python, PySpark, Spark SQL and Scala to deliver reliable batch and real-time data processing solutions. Collaborating with data scientists, software engineers and analysts, you will design data lakes and warehouses, implement cloud-native data platforms on AWS/Azure, and apply CI/CD practices with Docker, Kubernetes and

Qualifications

• Strong programming and SQL skills.
• Experience with large-scale enterprise data platforms.
• Proven ability to build and maintain data pipelines.

Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines for large datasets.
• Develop high-performance data processing using Python, PySpark, Spark SQL and Scala.
• Build batch and real-time pipelines using Kafka, Kinesis, Spark Streaming, AWS Glue and Airflow.
• Develop data ingestion frameworks across RDBMS, APIs, files and cloud storage.

Skills

Python

SQL

Spark

Kafka

Airflow

Docker

Kubernetes

ETL/ELT

Education

Bachelor's or Master's degree in Computer Science / IT

Tools

Databricks

Hadoop

Hive

Cloudera

Snowflake

Redis

Job description

UARROW PTE. LTD. in Singapore is seeking a highly skilled Data Engineer to design, build and maintain scalable data pipelines for large-scale datasets.

You will work with Python, PySpark, Spark SQL and Scala to deliver reliable batch and real-time data processing solutions. Collaborating with data scientists, software engineers and analysts, you will design data lakes and warehouses, implement cloud-native data platforms on AWS/Azure, and apply CI/CD practices with Docker, Kubernetes and