2101 Data Engineer

In All Media Inc.; Colombia; A distancia; COP 366.740.000 - 533.440.000; Jornada completa

Descripción de la vacante

Inallmedia.com is seeking a Senior Data Engineer to join our remote LATAM team. You will build data pipelines and cloud infrastructure using dbt, AWS, Snowflake, and BigQuery to power enterprise HR analytics for international clients.

The role focuses on a semantic layer, Model Context Protocol integration, and deploying AI-enabled query agents with Snowflake Cortex, while protecting PII and maintaining 99.5% uptime across distributed platforms.

Formación

• 5+ years of hands-on data engineering experience.
• Expertise in Snowflake data modeling, datamarts, warehouse design.
• Proficiency in Google BigQuery querying and optimization.
• Proficient Python scripting and REST API integrations.
• Proficient with Apache Airflow for orchestration and advanced SQL.

Responsabilidades

• Develop, optimize, and maintain secure data pipelines using dbt, PySpark, Python, and Airflow.
• Provision and maintain scalable cloud infrastructure with Terraform, AWS Glue/EMR/S3.
• Design and maintain Snowflake and BigQuery data models, datamarts and warehouses.
• Build semantic views and ontology layers on top of dbt models.
• Configure and deploy AI query agents via Snowflake Cortex and MCP.
• Monitor pipelines, ensure 99.5% uptime, and document thoroughly.

Conocimientos

Snowflake

BigQuery

dbt

Python

REST APIs

Airflow

PySpark

SQL

Data modeling

Data governance

Agile

English

Herramientas

Terraform

AWS Glue

AWS EMR

AWS S3

dbt

Descripción del empleo

Position: Senior Data Engineer

Location: Remote from LATAM

Contract Type: Full-time vendor

Time Zone Alignment: EST (±2 hours overlap)

About Inallmedia.com

Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams across LATAM. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

Project Overview

This role is embedded within a centralized Human Resources Data Mart (HRDM) engineering team, specifically supporting the Analytics product area. The primary objective is to maintain a secure, high-quality HR data warehouse that powers workforce analytics across international enterprise Centers of Excellence (COEs) and executive leadership.

As a Senior Data Engineer, you will build data pipelines and cloud infrastructure using dbt, AWS, Snowflake, and BigQuery, bridging traditional data architecture with modern AI capabilities. You will construct a dbt-based semantic layer and establish Model Context Protocol (MCP) and Snowflake Cortex workflows, enabling business leaders to query certified workforce data via natural-language AI agents.

Key Responsibilities

• Data Pipeline Engineering & ETL/ELT: Develop, optimize, and maintain secure data pipelines using dbt, PySpark, Python, and Apache Airflow to ingest HR data sources from REST APIs, real-time streams (e.g., Google Sheets, web APIs), and external platforms.
• Infrastructure & Cloud Resource Tooling: Provision, configure, and maintain scalable infrastructure for extraction, transformation, and loading processes utilizing Terraform, AWS Glue, AWS EMR, and AWS S3.
• Data Warehouse & Data Mart Modeling: Design and maintain optimized data models, data marts, and warehouse structures across Snowflake and Google BigQuery.
• Semantic Layer & Ontology Architecture: Build semantic views and ontology layers (mapping CORE → SEMANTIC → METRICS) on top of dbt models to provide business-friendly entity abstractions for BI tools and LLM agents.
• AI Agent & MCP Deployment: Configure and deploy generative AI query agents using Snowflake Cortex (Cortex Analyst, Cortex Search) and maintain MCP (Model Context Protocol) connections between Snowflake and internal AI tools for secure, natural-language data querying.
• Pipeline Monitoring, Quality & Compliance: Monitor data pipelines to enforce 99.5% uptime, build automated tests within a Data Quality Framework, ensure secure handling of sensitive data (PII), and produce comprehensive technical documentation.

Must-Have Skills

• Experience Level: 5+ years of dedicated, hands-on data engineering experience.
• Data Warehousing & Transformation: Deep expertise in Snowflake (data modeling, datamarts, warehouse design), Google BigQuery (querying and optimization), and dbt (data transformations).
• Programming & Ingestion: Strong object-oriented Python scripting capabilities and hands-on experience with REST API integrations and real-time data ingestion.
• Orchestration & Querying: Proficiency in Apache Airflow for pipeline orchestration and advanced, highly optimized SQL writing skills.
• Governance & Security: Demonstrated experience in the secure handling of large-scale, sensitive data (PII) and writing comprehensive technical documentation.
• Experience working in Agile teams and remote, distributed environments.
• Advanced/Fluent English communication skills for daily interaction.

Nice-to-Have Skills

• Semantic Layer Design: Experience in semantic modeling design to provide business-object abstractions over dbt and warehouse models.
• LLM-Native Query Layers: Hands-on experience with Snowflake Cortex (Cortex Analyst, Cortex Search) or equivalent LLM query frameworks.
• Agentic Frameworks: Exposure to MCP (Model Context Protocol) or similar tool-calling and context-exposure frameworks.
• Context Engineering: Familiarity with prompt and context engineering to ground AI agents in certified enterprise data sources.

Time Zone & Collaboration

The role requires collaboration with teams aligned to US Eastern Standard Time (EST). Flexibility to overlap a minimum of 4 core working hours with US time zones is expected.

Language

All interviews, documentation, and daily communication will be in English.

#LI