GCP Data Engineer: Scalable Pipelines & AI Enablement

Second Talent

Kuala Lumpur

Sur place

MYR 90 000 - 150 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

Second Talent is seeking an experienced Data Engineer to join the technology team in Kuala Lumpur. You will build and manage scalable batch and streaming data pipelines on GCP, enabling advanced analytics and AI solutions.

You will work with BigQuery, Dataflow, Dataproc, Composer, Dataform, and Cloud Functions, loading and transforming data from diverse sources, and guiding migration from legacy systems. Collaboration with analysts and business teams is essential to deliver reliable,

Qualifications

3–5 years of professional experience in data engineering or ETL development.
Hands-on experience with GCP Data Stack (BigQuery, Dataflow, Composer, Dataproc).
Strong SQL and Python programming skills.
Understanding of data modelling and performance optimization techniques.
Willingness to learn and contribute to large-scale migration projects.
Familiarity with Azure Data Stack is a plus.

Responsabilités

Architect, develop, and maintain scalable batch and streaming data pipelines on GCP (BigQuery, Dataflow, Dataproc, Composer, Dataform, Cloud Functions).
Design and execute processes to load, transform, and optimize data within BigQuery for analytics and reporting.
Integrate data from diverse sources, including external APIs and databases.
Lead data migration initiatives from Oracle and MicroStrategy to the cloud.
Enforce data quality, governance, and security across platforms.
Collaborate with analysts and business teams to support reporting requirements.