Senior Data Engineer — Remote & Growth‑Driven

AgileEngine; Ciudad de México; Presencial; MXN 2.573.000 - 3.259.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and govern ETL pipelines with Airflow while leading a team of senior developers.

You will drive the AWS data stack (Athena, EKS) and collaborate with DevOps, review PRs, and uphold engineering standards.

Formación

• 7+ years of engineering experience with ETL pipelines and large data systems.
• Hands-on OLAP data architecture experience with modern tools.
• Data lake on object storage (S3) with partitioning and Parquet/ORC formats.
• Deep DAG-style workflow design and Airflow-led orchestration.
• Experience with AWS data stack: S3, Athena, EKS; collaboration with DevOps.
• Strong Python backend skills (FastAPI/Flask).
• REST and GraphQL familiarity; Docker and PostgreSQL proficient.
• Proficient in Mac/Linux terminal environments and AI-assisted tooling.

Responsabilidades

• Design and own ETL pipelines at scale for internal and external data sources.
• Make architecture decisions on partitioning, formats, and near-real-time processing for OLAP workloads on data lake.
• Own Airflow DAG design and scheduling; guide pipeline structure and dependencies.
• Drive AWS data stack usage and collaborate with DevOps for infra decisions.
• Review PRs and enforce code quality; mentor senior developers.

Conocimientos

ETL pipelines

OLAP data architecture

Data lake on object storage

Airflow DAGs

AWS data stack

Python (FastAPI/Flask)

REST/GraphQL

Docker

PostgreSQL

Airflow/Orchestrators

AI-assisted development tools

Mac/Linux terminal

English (Upper-intermediate)

Herramientas

Airflow

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

Docker

PostgreSQL

EKS/Kubernetes

Python

FastAPI

Flask

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and govern ETL pipelines with Airflow while leading a team of senior developers.

You will drive the AWS data stack (Athena, EKS) and collaborate with DevOps, review PRs, and uphold engineering standards.