Senior Data Engineer Lead: Cloud Data Pipelines & AI Tools

Viventis Search Asia; Taguig; Presencial; PHP 1 800 000 - 3 400 000; Tempo integral

Resumo da oferta

Viventis Search Asia is seeking an experienced Lead Data Engineer to transform legacy SSIS/SSRS pipelines into modular, cloud-native data architectures. You will design reusable data patterns, validate new technologies through POCs/POVs, and leverage AI-enabled tools to accelerate engineering work.

You will collaborate across data architects, platform engineers, analysts, and product owners to deliver scalable data pipelines on Azure and GCP while mentoring junior engineers and optimizing cost

Qualificações

• 8+ years of data engineering experience, including at least 3+ years in a lead or senior role.
• Proven ability to design and implement data design patterns (CDC, SCD, Medallion, Data Vault, streaming, batch).
• Deep expertise with Databricks, Apache Spark, dbt, Fivetran, Census, Airflow, and Kafka.
• Solid experience across Azure and/or GCP (e.g., Synapse, Data Factory, BigQuery, Pub/Sub).
• Hands-on experience modernizing legacy ETL (SSIS/SSRS) workloads into cloud-native pipelines.
• Demonstrated ability to build POCs/POVs validating new tools or architectures.
• Working knowledge of AI-assisted engineering tools and programming in SQL and Python/Scala/Java.
• Strong problem-solving, architectural thinking, and collaboration skills.

Responsabilidades

• Modernize legacy ETL pipelines using Databricks, dbt, Fivetran, and Airflow.
• Architect reusable data design patterns for ingestion, transformation, and consumption layers across the Lakehouse.
• Develop and lead POCs/POVs to validate new technologies and influence enterprise roadmap.
• Leverage AI-enabled tools to accelerate engineering and automate testing, documentation, and optimization.
• Apply ML for operational intelligence to detect anomalies and optimize compute/scheduling.
• Drive CI/CD, version control, peer reviews, and observability across the data platform.
• Collaborate with data architects, platform engineers, analysts, and product owners to translate needs into solutions.
• Mentor data engineers and promote modern data engineering practices.
• Optimize Spark workloads, storage tiers, and orchestration in Azure and GCP environments.
• Administer and test data system reliability and monitor performance.

Conhecimentos

Data engineering

Lead role

SQL

Python

Scala

Java

Databricks

Apache Spark

dbt

Fivetran

Airflow

Kafka

Azure/GCP

Data Vault/Medallion

Formação académica

Bachelor's degree

Ferramentas

Synapse

Data Factory

BigQuery

Pub/Sub

Delta Live Tables

Iceberg

Descrição da oferta de emprego

Viventis Search Asia is seeking an experienced Lead Data Engineer to transform legacy SSIS/SSRS pipelines into modular, cloud-native data architectures. You will design reusable data patterns, validate new technologies through POCs/POVs, and leverage AI-enabled tools to accelerate engineering work.

You will collaborate across data architects, platform engineers, analysts, and product owners to deliver scalable data pipelines on Azure and GCP while mentoring junior engineers and optimizing cost