Data Engineer - Scalable ETL & Data Pipelines

nSearch Global Pte Ltd.; Singapore; Presencial; SGD 90 000 - 130 000; Tempo integral

Resumo da oferta

nSearch Global Pte Ltd. in Singapore is seeking a data engineer to design, develop and maintain robust ETL pipelines for ingestion, transformation and integration of data from multiple sources. You will build scalable components and dashboards for production use.

Strong Python and SQL skills, experience with dataframe libraries (Polars, pandas), GitLab CI/CD, and Linux shell scripting are required. The role offers collaboration across teams to improve reliability and performance on large

Qualificações

• Degree with 4-7 years of professional experience in data engineering or related software role.
• Strong Python and SQL with complex data transformations and quality monitoring.
• Hands-on experience with dataframe processing libraries (e.g. Polars, pandas) for high-performance execution and memory-efficient processing of large datasets.
• Experience with database management, data warehousing and ETL processes for data ingestion and integration.
• Experience with Git, branching strategies, merge requests, code review, and CI/CD pipelines for automated testing and deployment.
• Good knowledge of Linux/Unix environments, shell scripting and CLI tools for data processing.
• Experience with cloud platforms and orchestration/CI‑CD tooling is preferred.

Responsabilidades

• Design, develop and maintain ETL processes and data pipelines for ingestion, transformation and integration.
• Develop modular, production-quality code for statistical production processes and optimise legacy processes.
• Design and maintain database schemas, data models and storage structures for large datasets.
• Build reusable data engineering components, libraries, configuration frameworks, logging standards and utilities.
• Implement and maintain CI/CD pipelines for data engineering workflows with automated testing and deployment.
• Establish version control with GitLab, set up code review frameworks, and produce technical documentation.
• Monitor and troubleshoot pipelines, perform root-cause analysis and improve reliability and performance for large-scale datasets.

Conhecimentos

Python

SQL

Data transformations

Data quality monitoring

Shell scripting

Linux/Unix

Formação académica

Bachelor's degree in Computer Science or related field

Ferramentas

Git

GitLab

Polars

pandas

CI/CD

Descrição da oferta de emprego

nSearch Global Pte Ltd. in Singapore is seeking a data engineer to design, develop and maintain robust ETL pipelines for ingestion, transformation and integration of data from multiple sources. You will build scalable components and dashboards for production use.

Strong Python and SQL skills, experience with dataframe libraries (Polars, pandas), GitLab CI/CD, and Linux shell scripting are required. The role offers collaboration across teams to improve reliability and performance on large