Data Engineer - ETL & Data Pipelines (SQL/Python, AWS)

NSEARCH GLOBAL PTE. LTD.; Singapore; Presencial; SGD 70 000 - 120 000; Tempo integral

Resumo da oferta

NSEARCH GLOBAL PTE. LTD. in Singapore is seeking a Data Engineer to develop and maintain ETL pipelines ingesting HR data into ODIN. You will build SQL/Python logic for data cleansing, transformation and reconciliation, and enhance data models and data sources for reporting and analytics.

The role includes automating validation checks, monitoring pipelines, and supporting audits and remediation efforts. Prior experience with ETL, data warehousing, and cloud platforms is essential.

Qualificações

• Strong SQL and Python development experience with data pipelines.
• Experience with AWS data services (S3, IAM, Parquet) or similar cloud platforms.
• Familiarity with Spark/Databricks is advantageous but not required for the ODIN environment.
• Hands-on understanding of ETL, data pipeline design and operations, data warehousing and data modelling.

Responsabilidades

• Develop and maintain ETL pipelines and file-based interfaces for ingesting HR data into ODIN, including data profiling, mapping, specifications and dataset onboarding.
• Build and maintain SQL and Python logic to cleanse, standardise, transform and reconcile HR data into reliable, reusable datasets.
• Enhance ODIN data models, tables and dependencies to meet new requirements, with traceable mappings, definitions and processing rules.
• Automate validation, reconciliation and cleansing checks; investigate anomalies, trace lineage, resolve root causes and verify fixes.
• Monitor pipelines and interfaces, troubleshoot failures, perform reruns and improve reliability, performance, maintainability and operational documentation.
• Develop governed datasets, Athena tables/views and queries, and Tableau data sources/workbooks for approved reporting and analytics needs.
• Translate stakeholder requirements into data mappings, transformation rules and technical solutions, while documenting decisions and supporting timely delivery.
• Provide technical evidence for audits, access reviews and assurance activities, and support required remediation.

Conhecimentos

SQL

Python

ETL pipelines

Data warehousing

Ferramentas

AWS

Parquet

Athena

Databricks

Descrição da oferta de emprego

NSEARCH GLOBAL PTE. LTD. in Singapore is seeking a Data Engineer to develop and maintain ETL pipelines ingesting HR data into ODIN. You will build SQL/Python logic for data cleansing, transformation and reconciliation, and enhance data models and data sources for reporting and analytics.

The role includes automating validation checks, monitoring pipelines, and supporting audits and remediation efforts. Prior experience with ETL, data warehousing, and cloud platforms is essential.