GCP Data Engineer: Scalable Pipelines & AI Enablement

Second Talent

Kuala Lumpur

On-site

MYR 90,000 - 150,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Second Talent is seeking an experienced Data Engineer to join the technology team in Kuala Lumpur. You will build and manage scalable batch and streaming data pipelines on GCP, enabling advanced analytics and AI solutions.

You will work with BigQuery, Dataflow, Dataproc, Composer, Dataform, and Cloud Functions, loading and transforming data from diverse sources, and guiding migration from legacy systems. Collaboration with analysts and business teams is essential to deliver reliable,

Qualifications

3–5 years of professional experience in data engineering or ETL development.
Hands-on experience with GCP Data Stack (BigQuery, Dataflow, Composer, Dataproc).
Strong SQL and Python programming skills.
Understanding of data modelling and performance optimization techniques.
Willingness to learn and contribute to large-scale migration projects.
Familiarity with Azure Data Stack is a plus.

Responsibilities

Architect, develop, and maintain scalable batch and streaming data pipelines on GCP (BigQuery, Dataflow, Dataproc, Composer, Dataform, Cloud Functions).
Design and execute processes to load, transform, and optimize data within BigQuery for analytics and reporting.
Integrate data from diverse sources, including external APIs and databases.
Lead data migration initiatives from Oracle and MicroStrategy to the cloud.
Enforce data quality, governance, and security across platforms.
Collaborate with analysts and business teams to support reporting requirements.