Senior Data Engineer: AI-Driven Data Pipelines

INGEPSY; Sur; Presencial; COP 280.260.000 - 404.820.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Exciting projects with Fortune 500 and

Flextime

Descripción de la vacante

AgileEngine in Cali, VAC, Colombia, seeks a Senior Data Engineer to build and maintain pipelines and data models for a centralized HR data warehouse. You will work with Snowflake, DBT, Python, and Airflow to design semantic layers for BI tools and AI agents, and implement MCP connections for secure data exposure.

The role emphasizes real-time data processing, robust testing, and scalable data infrastructure, with a strong focus on data quality and governance across HR data sources.

Formación

• 4+ years of experience in data engineering or related role.
• Proficient with Snowflake data modeling, datamarts, and warehouse design.
• DBT for data transformations.
• Python proficiency for data scripting and OO programming.
• Airflow for pipeline orchestration.
• REST API integration and data ingestion.
• BigQuery querying and optimization.
• Secure handling of large-scale and sensitive data.
• Real-time data processing from APIs or sheets.
• Strong SQL with highly optimized queries.

Responsabilidades

• Develop and maintain secure, efficient data pipelines using DBT, PySpark, and Python applications in a cloud environment for HR data sources.
• Build infrastructure and tooling for ETL of data from varied sources using Python, DBT, Terraform, and AWS services (Glue, EMR, S3).
• Identify and implement internal process improvements; develop tests within the Data Quality Framework; monitor pipelines for 99.5% uptime; maintain data models for partner teams.
• Design and build semantic views and ontology layers over dbt models to make HR data consumable by BI tools and AI agents/LLMs.
• Develop and deploy AI agents (Snowflake Cortex) for HR COE use cases enabling NL querying over certified HRDM data.
• Configure MCP connections between Snowflake and internal AI tooling to securely expose HR data to conversational interfaces.

Conocimientos

Snowflake

DBT

Python

Airflow

REST API

BigQuery

SQL

Herramientas

Terraform

AWS

Descripción del empleo

AgileEngine in Cali, VAC, Colombia, seeks a Senior Data Engineer to build and maintain pipelines and data models for a centralized HR data warehouse. You will work with Snowflake, DBT, Python, and Airflow to design semantic layers for BI tools and AI agents, and implement MCP connections for secure data exposure.

The role emphasizes real-time data processing, robust testing, and scalable data infrastructure, with a strong focus on data quality and governance across HR data sources.