Data Engineer: Real-Time Cloud Data Pipelines

Activate Interactive Pte Ltd.; Singapore; On-site; SGD 72,000 - 108,000; Full time

Job summary

Activate Interactive Pte Ltd is hiring for a data engineering role to design, develop and deploy data tables, views and marts in data warehouses and data lakes. You will extract, clean and transform data, including web scraping, and build scalable batch and real-time pipelines on cloud platforms.

The role collaborates with Project Managers, Data Architects, Business Analysts and developers in an Agile environment.

Qualifications

• Experience in designing and implementing data warehouses, data lakes and data marts.
• Proficient in data extraction, cleaning, transformation and web scraping.
• Experience building large-scale batch and real-time data pipelines on cloud platforms.

Responsibilities

• Design, develop and deploy data tables, views and marts in data warehouses and data lakes.
• Build and maintain ETL/ELT pipelines using SQL, Python and cloud services.
• Develop backend APIs and integrate with databases to support applications.

Skills

Database design

Cloud platforms

ETL pipelines

Python

SQL

Web scraping

Data governance

REST APIs

Tools

SSIS

AWS DMS

Python

AWS Lambda

ECS

AWS Glue

Spring

Job description

Activate Interactive Pte Ltd is hiring for a data engineering role to design, develop and deploy data tables, views and marts in data warehouses and data lakes. You will extract, clean and transform data, including web scraping, and build scalable batch and real-time pipelines on cloud platforms.

The role collaborates with Project Managers, Data Architects, Business Analysts and developers in an Agile environment.