Data Engineer: ETL Pipelines, Data Quality & Dashboards

Visa Hunt; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

Visa Hunt is seeking a Data Engineer to join the Data Engineering & Infrastructure team working on ODIN. You will support ingestion, transformation, data quality and downstream data services, reporting to the Team Lead and collaborating with PSD officers, vendors, and business users.

You will build and maintain ETL pipelines, work with ODIN data models, automate validation, and ensure reliable downstream consumption of HR data.

Qualifications

• Hands-on experience building data pipelines, transformations and validations.
• Experience with cloud data platforms (AWS) and data warehousing.
• Familiarity with data governance, lineage and testing.

Responsibilities

• Data Pipeline & Interface Engineering: Develop and maintain ETL pipelines and file-based interfaces for ingesting HR data into ODIN.
• Data Transformation & Modelling: Build SQL and Python logic to cleanse, standardise and reconcile data.
• Data Model & Dataset Maintenance: Enhance ODIN data models and dependencies with clear mappings and rules.
• System Enhancements & Testing: Review requirements, run tests and document defects.
• Data Quality, Validation & Lineage: Automate checks, trace lineage and verify fixes.
• Pipeline Operations & Reliability: Monitor pipelines, troubleshoot failures and improve reliability.
• Downstream Data Consumption: Develop Athena tables/views and Tableau data sources for reporting.
• Technical Collaboration & Delivery: Translate requirements and document decisions for timely delivery.

Skills

SQL proficiency

Python scripting

AWS data services

Data modelling

Tools

Spark

Databricks

Airflow

SQL

Job description

Visa Hunt is seeking a Data Engineer to join the Data Engineering & Infrastructure team working on ODIN. You will support ingestion, transformation, data quality and downstream data services, reporting to the Team Lead and collaborating with PSD officers, vendors, and business users.

You will build and maintain ETL pipelines, work with ODIN data models, automate validation, and ensure reliable downstream consumption of HR data.