Senior Data Engineer: AI-Ready Pipelines & Flexible Hours

AgileEngine, LLC.; Metropolitana; Híbrido; COP 217.980.000 - 342.540.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

Exciting projects

Flextime

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior/Lead Data Engineer to build and maintain HR data pipelines and data models in Snowflake, DBT, Python, and Airflow. You will design semantic layers for BI tools and AI agents, enabling streamlined access to HR data.

The role emphasizes secure data handling, real-time processing, and collaboration across teams to deliver scalable data platforms capable of supporting advanced analytics and agentic querying.

Formación

• 4+ years of professional data engineering experience.
• Snowflake data modeling, datamarts, and data warehouse design.
• DBT for data transformations.
• Python development and data scripting.
• Airflow for pipeline orchestration.
• REST API integration and data ingestion.
• Google BigQuery querying and optimization.
• Strong SQL with optimized queries.

Responsabilidades

• Develop and maintain secure, efficient data pipelines using DBT, PySpark, and Python applications within a supported cloud environment for HR data sources.
• Build the infrastructure and tooling required for optimal extraction, transformation, and loading of data from a wide variety of sources using Python, DBT, Terraform, and AWS technologies such as Glue, EMR, and S3.
• Identify and implement internal process improvements, develop tests within the Data Quality Framework, monitor pipelines to maintain 99.5% uptime, and create and maintain the data models used by partner teams.
• Design and build semantic views and ontology layers on top of existing dbt models (CORE → SEMANTIC → METRICS) so HR data is consumable by both BI tools and AI agents/LLMs, defining business-friendly entities, relationships, and metrics that abstract away raw warehouse structure.
• Develop and deploy AI agents (e.g., via Snowflake Cortex Analyst/Cortex Search) for HR COE use cases — including PE, iCIMS, LMS, and Sales/CS Worker agents — enabling natural-language querying over certified HRDM data.
• Configure and maintain MCP (Model Context Protocol) connections between Snowflake and internal AI tooling to securely expose HR data to conversational and agentic interfaces.

Conocimientos

Snowflake

DBT

Python

Airflow

REST API integration

Google BigQuery

SQL

4+ years of experience

Security handling of large-scale data

Real-time data processing

Herramientas

Snowflake Cortex

MCP

Terraform

AWS (Glue, EMR, S3)

Descripción del empleo

AgileEngine, LLC. is seeking a Senior/Lead Data Engineer to build and maintain HR data pipelines and data models in Snowflake, DBT, Python, and Airflow. You will design semantic layers for BI tools and AI agents, enabling streamlined access to HR data.

The role emphasizes secure data handling, real-time processing, and collaboration across teams to deliver scalable data platforms capable of supporting advanced analytics and agentic querying.