Lead Data Engineer - OLAP, Airflow & AWS Architect

AgileEngine, LLC.; Puebla de Zaragoza; Presencial; MXN 1.000.000 - 1.700.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility — 100% remote

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead ETL design and governance.

You will define DAG-based orchestration with Airflow, drive AWS data stack usage (Athena, EKS), and guide senior developers while upholding code quality and scalable engineering practices.

Formación

• 7+ years of engineering experience with ETL pipelines and large data systems.
• Hands-on OLAP data architecture experience and cloud data lake design.
• Strong Python development skills and REST/GraphQL APIs.
• Proficient with Airflow-based DAGs and AWS data services.
• Experience with object storage data lakes (S3) and partitioning strategies.

Responsabilidades

• Design and own ETL pipelines and data architecture for large-scale analytics.
• Make architectural calls on partitioning, file formats, and near-real-time processing.
• Own Airflow DAG design, scheduling, dependencies, and triggering strategies.
• Drive AWS data stack initiatives and collaborate with DevOps on infra decisions.
• Review PRs, enforce quality standards, and mentor senior developers.

Conocimientos

ETL design

OLAP architecture

Airflow

AWS data stack

Python

REST/GraphQL

Docker

PostgreSQL

Mac/Linux

AI-assisted development tools

Herramientas

Airflow

S3/Athena

Trino/Presto

BigQuery

Snowflake

Kubernetes

Parquet/ORC

Descripción del empleo

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead ETL design and governance.

You will define DAG-based orchestration with Airflow, drive AWS data stack usage (Athena, EKS), and guide senior developers while upholding code quality and scalable engineering practices.