Data Engineer - AI Data Pipelines (Hybrid: Pasig/Remote)

Insight Technology; Pasig; Hybrid; PHP 1,339,200 - 2,008,800; Full time

Benefits offered by this job

Hybrid work model

Health insurance

Job summary

Insight Technology is seeking a Data Engineer to join the AI Development team, building and maintaining data pipelines for AI transformation and analytics using Databricks, GCP, and Azure. You will ensure clean, reliable data for model training, RAG-based search, and enterprise reporting.

You will design scalable ETL/ELT processes, maintain a Databricks lakehouse, implement data quality checks, and collaborate with AI developers and stakeholders to prepare optimized datasets for Power BI

Qualifications

• 3+ years of data engineering focusing on production data pipelines.
• Proficient with Databricks (PySpark) and lakehouse support.
• Hands-on experience with cloud data services in Azure or GCP.
• Experience building and optimizing ETL/ELT pipelines.
• Proficient in Python and SQL; Java familiarity is a plus.

Responsibilities

• Build and maintain scalable ETL/ELT processes and data pipelines from ERP, CRM, and ecommerce data for AI agents and analytics.
• Support maintenance and optimization of Databricks-based data lakehouse for data science and BI needs.
• Implement data quality checks and monitoring to ensure data integrity for AI apps and dashboards.
• Partner with AI developers and business stakeholders to prepare optimized datasets for AI use cases.
• Utilize Databricks MCP and Feature Store to prepare data for ML models and AI apps.
• Support data governance, including lineage and security; catalog data assets.
• Work with Azure and GCP native services to implement scalable storage and compute solutions.
• Assist in modeling clean datasets to support Power BI reporting and BI initiatives.

Skills

Python

SQL

English communication

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

PySpark

Databricks Workflows

Azure

GCP

Power BI

Informatica

Job description

Insight Technology is seeking a Data Engineer to join the AI Development team, building and maintaining data pipelines for AI transformation and analytics using Databricks, GCP, and Azure. You will ensure clean, reliable data for model training, RAG-based search, and enterprise reporting.

You will design scalable ETL/ELT processes, maintain a Databricks lakehouse, implement data quality checks, and collaborate with AI developers and stakeholders to prepare optimized datasets for Power BI