Data Engineer: Real-Time Analytics & Pipelines

Visa Hunt; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Visa Hunt is seeking a Reporting and Analytics Developer/ Data Engineer in Singapore. The role focuses on designing and deploying data tables, views and marts, and building scalable batch and real-time data pipelines.

You will integrate data silos and architect data-driven solutions across data warehouses and lakes. You will collaborate with project managers, data architects and developers, and work in an Agile environment with CI/CD practices.

Qualifications

• Proficient in SQL, pandas, and R for data cleaning and transformation.
• Skilled in building ETL pipelines with SSIS, AWS DMS, Python, AWS Lambda, ECS, AWS Glue, Spring.
• Experience with diverse databases (SQL, PostgreSQL, AWS S3, Athena, MongoDB, etc.).
• Familiar with cloud platforms like AWS, Azure, Google Cloud (GCP).
• Experience delivering production-grade data pipelines and data integration.

Responsibilities

• Design, develop and deploy data tables, views and marts in data warehouses, data lake and data virtualization.
• Build large-scale batch and real-time data pipelines with appropriate frameworks.
• Integrate data silos to enable scalable and compliant data access.
• Develop backend APIs and support databases for applications.
• Collaborate with cross-functional teams to build data-driven products.
• Participate in CI/CD and pair programming to improve code quality.

Skills

SQL

Python

Data Cleaning

Data Transformation

Tools

SSIS

AWS DMS

Python

AWS Lambda

ECS

AWS Glue

Spring

Airflow

Job description

Visa Hunt is seeking a Reporting and Analytics Developer/ Data Engineer in Singapore. The role focuses on designing and deploying data tables, views and marts, and building scalable batch and real-time data pipelines.

You will integrate data silos and architect data-driven solutions across data warehouses and lakes. You will collaborate with project managers, data architects and developers, and work in an Agile environment with CI/CD practices.