Assistant Manager - Data Engineering

Latent View Analytics Limited; Hinoba-an; On-site; PHP 1,400,000 - 2,400,000; Full time

Job summary

Latent View Analytics Limited in the Philippines is seeking a Lead Data Engineer to architect and deploy data pipelines across on-prem and cloud environments. You should be comfortable with PostgreSQL, GCP/BigQuery, Spark, Kubernetes, and Jenkins, and own how pipelines are designed and released.

As the technical lead, you will drive decisions, review teammates' work, and mentor others while maintaining reliable ETL/ELT processes, monitoring, and robust CI/CD practices.

Qualifications

• 5+ years hands-on data engineering with ownership of production pipelines.
• Strong experience with GCP, BigQuery, and cloud data architectures.
• Proficient in Spark for distributed processing and SQL optimization.

Responsibilities

• Build and maintain end-to-end ETL/ELT pipelines across on‑prem and cloud environments.
• Set up Jenkins pipelines for deployment and orchestration.
• Write and optimize PostgreSQL queries and schemas.
• Develop data solutions on GCP including BigQuery; write Spark jobs.
• Deploy and manage containerized workloads on Kubernetes; ensure reliability.

Skills

Hands-on data engineering

BigQuery

Apache Spark

PostgreSQL

Kubernetes

Jenkins

Python

SQL

Tools

Terraform

Helm

dbt

Job description

We're hiring a Lead Data Engineer to build and deploy data pipelines across on-prem and cloud environments. You should be comfortable in PostgreSQL, GCP/BigQuery, Spark, Kubernetes, and Jenkins, and ready to take ownership of how pipelines get architected and deployed.

As the lead on this, you'll drive technical decisions, review other engineers' work, and be the go-to person when something in the pipeline needs fixing or rethinking.

Key Responsibilities

• Build and maintain ETL/ELT pipelines end to end
• Set up and manage Jenkins pipelines for deployment and job orchestration
• Write and optimize PostgreSQL queries and schemas
• Build data solutions on GCP, including BigQuery
• Write Spark jobs for distributed data processing
• Deploy and manage containerized workloads on Kubernetes
• Keep pipelines monitored and reliable - handle errors, logging, and recovery properly
• Write clean, tested Python and SQL
• Review code and keep the team's CI/CD and version control practices solid
• Mentor other data engineers on the team

Required Qualifications

• 5+ years of hands-on data engineering experience, with real ownership of production pipelines (not just contributing to them)
• Strong experience with GCP, including big data ETL and containerized ETL workloads
• Proficiency with Apache Spark for distributed/batch processing
• Experience with Kubernetes for container orchestration
• Solid track record building and managing Jenkins pipelines
• Strong PostgreSQL skills, including query optimization and schema design in an on-prem setting
• Experience running ETL workflows in on-prem environments, not just cloud-native setups
• Strong SQL and Python skills
• Experience building ETL/ELT pipelines from raw source data through to modeling-ready datasets

Preferred Qualifications

• Experience with hybrid architecture - moving and syncing data between on-prem and cloud
• Familiarity with dimensional data modeling for analytics/BI (star schema, etc.)
• Experience with infrastructure-as-code (Terraform, Helm) for Kubernetes/GCP
• Familiarity with data quality/testing tools like Great Expectations or dbt tests
• Experience mentoring or leading other data engineers