Data Engineer, AI Pipelines & Lakehouse (Hybrid)

Insight Enterprises, Inc.; Pasig; Hybrid; PHP 900,000 - 1,300,000; Full time

Benefits offered by this job

Health insurance (HMO) on Day 1 with 2

Flexible location (international trips

Job summary

Insight Enterprises, Inc. is seeking a Data Engineer to build and maintain data pipelines powering AI transformation and analytics. You’ll work with Databricks, GCP, and Azure to ensure clean, reliable data for AI model training, RAG-based search, and enterprise reporting.

The role focuses on ETL/ELT development, lakehouse maintenance, data quality, and collaboration with AI developers and stakeholders in an Agile setup. Hybrid work in Pasig is offered.

Qualifications

• 3+ years of data engineering experience.
• Proficient in Databricks, PySpark, and lakehouse support.
• Hands-on with Azure or GCP cloud data services.
• Experience with ETL/ELT pipelines and data transformation.
• Proficient in Python and SQL; knowledge of Java is a plus.
• Experience with Informatica and Power BI data modeling.
• Strong English communication and Agile teamwork.
• Bachelor's degree in CS/Engineering or related field.

Responsibilities

• Build and maintain scalable ETL/ELT processes and data pipelines to ingest and transform data from various sources (ERP, CRM, ecommerce) for AI agents and analytics.
• Support the maintenance and optimization of our Databricks-based data lakehouse to ensure performance and reliability for data science and business intelligence needs.
• Implement data quality checks and monitoring to ensure data integrity for AI applications and dashboards.
• Partner with AI developers and business stakeholders to prepare optimized datasets for specific AI use cases.
• Utilize the Databricks platform, including the MCP and Feature Store, to prepare data for machine learning models and AI applications.
• Support data governance practices, including lineage and security; catalog and document data assets.
• Work with native cloud services on Azure and GCP to implement scalable data storage and compute solutions.
• Assist in modeling clean, reliable datasets to support Power BI reporting and business intelligence initiatives.

Skills

Databricks

Python

SQL

Power BI

ETL/ELT

Azure/GCP

Data Lakehouse

Communication (English)

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Informatica

Job description

Insight Enterprises, Inc. is seeking a Data Engineer to build and maintain data pipelines powering AI transformation and analytics. You’ll work with Databricks, GCP, and Azure to ensure clean, reliable data for AI model training, RAG-based search, and enterprise reporting.

The role focuses on ETL/ELT development, lakehouse maintenance, data quality, and collaboration with AI developers and stakeholders in an Agile setup. Hybrid work in Pasig is offered.