Senior Data Engineer - Cloud Pipelines & ETL

PERSOL

Singapore

On-site

SGD 100,000 - 150,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PERSOL Singapore is seeking a data engineer with 5 years of experience to design and optimize data pipelines across sources and formats. You will write efficient SQL, work with Python-based ETL, and collaborate with analysts and data scientists to meet reporting needs.

You will build and maintain cloud-based data stores, ensure data quality, and contribute to scalable architectures using Spark/Hadoop ecosystems. A strong background in security and governance is a plus.

Qualifications

  • Bachelor's degree in CS or related field.
  • 5 years of data engineering experience.
  • Strong SQL, ETL (Teradata), Python.
  • Experience with Kafka messaging.
  • Informatica development experience.
  • Experience implementing complex ETL and data extraction projects from scratch.
  • Fluency in Python, Spark, Hive-QL, Hadoop ecosystem, data-centric workflow management tools Unix/Linux/HDFS environments. Proficiency in SQL and RDBMS.
  • Good working knowledge of Git and CI/CD pipelines.
  • Experience in Graph databases desirable but not mandatory.
  • Thorough knowledge of data security, privacy, and compliance regulations.

Responsibilities

  • Assist in designing and implementing data pipelines to collect, process, and store data from various sources.
  • Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
  • Collaborate with data analysts and data scientists to understand data requirements and provide necessary data support.
  • Organize, build and maintain data stores of structured and unstructured data on a cloud environment.
  • Build data pipelines for scalable processing of large volumes of data.
  • Develop scalable and high-performance architectures using modern development frameworks.
  • Work with business stakeholders to gather requirements and convert into effective solutions; monitor data pipelines for quality and reliability.
  • Enhance and maintain existing applications, identifying areas for optimization and improvement.
  • Document data processes, workflows, and data models for clear team communication.
  • Maintain technical documentation related to application design, workflows, and deployment.

Skills

SQL
Python
ETL
Kafka
Informatica
Spark
Hadoop
Unix/Linux
Git
CI/CD

Education

Bachelor's degree in computer science or related field

Tools

Kafka
Informatica
Git
CI/CD tools
Spark
Hadoop

Job description

PERSOL Singapore is seeking a data engineer with 5 years of experience to design and optimize data pipelines across sources and formats. You will write efficient SQL, work with Python-based ETL, and collaborate with analysts and data scientists to meet reporting needs.

You will build and maintain cloud-based data stores, ensure data quality, and contribute to scalable architectures using Spark/Hadoop ecosystems. A strong background in security and governance is a plus.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Scalable Pipelines & Cloud Data
Senior Data Engineer: Scalable Pipelines & Cloud Data

Horizon Computer Management • Singapore

On-site
SGD 120,000 - 160,000
Senior Data Engineer - Cloud Pipelines & Data Quality
Senior Data Engineer - Cloud Pipelines & Data Quality

Sggovterp • Singapore

On-site
SGD 90,000 - 150,000
Senior Data Engineer: Cloud Pipelines & Analytics
Senior Data Engineer: Cloud Pipelines & Analytics

Ernst & Young Solutions LLP • Singapore

On-site
SGD 90,000 - 130,000
Databricks experience
Snowflake experience
Power BI experience
+1
Senior Data Engineer: Build Scalable Data Pipelines
Senior Data Engineer: Build Scalable Data Pipelines

TALENTSIS PTE. LTD. • Singapore

On-site
SGD 90,000 - 120,000
Data Engineer: Pipelines, SQL & Cloud Platform
Data Engineer: Pipelines, SQL & Cloud Platform

TALENTSIS PTE. LTD. • Singapore

On-site
SGD 60,000 - 110,000
Senior Data Engineer - Lakehouse & Cloud Pipelines
Senior Data Engineer - Lakehouse & Cloud Pipelines

optimum solutions (singapore) pte ltd • Singapore

On-site
SGD 120,000 - 180,000
Senior Data Engineer: Scalable ML Pipelines & Governance
Senior Data Engineer: Scalable ML Pipelines & Governance

PERSOL • Singapore

On-site
SGD 180,000 - 240,000
Senior Data Engineer: Scalable Pipelines & Warehouses
Senior Data Engineer: Scalable Pipelines & Warehouses

TALENTSIS PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer: ETL Pipelines & Data Quality
Data Engineer: ETL Pipelines & Data Quality

TALENTVIS SINGAPORE PTE. LTD. • Singapore

On-site
SGD 90,000 - 120,000
Senior Data Engineer: Build Scalable Data Pipelines
Senior Data Engineer: Build Scalable Data Pipelines

TALENTSIS PTE. LTD. • Singapore

On-site
SGD 70,000 - 110,000