Lead Data Engineer: Remote, Scale Analytics & ETL

AgileEngine; Santiago de Querétaro; Presencial; MXN 900.000 - 1.500.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility - 100% remote

Meaningful projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will design ETL pipelines, orchestrate with Airflow, and drive the AWS data stack including S3, Athena, and EKS, while guiding a team of senior developers.

You will work across OLAP workloads, data lake on object storage, and collaborate with DevOps to ensure performance, reliability, and maintainability.

Formación

• 7+ years of engineering experience designing and implementing ETL pipelines for large-volume data systems.
• Hands-on experience with OLAP-style analytical data architecture.
• Experience with data lakes on object storage (S3 or equivalent) and serverless queries.

Responsabilidades

• Design and own ETL pipelines that extract, transform, and validate data at scale.
• Make architectural decisions on partitioning, file formats, and near-real-time processing for OLAP workloads.
• Own scheduling of DAGs in Airflow and define pipeline structure and triggering strategy.
• Drive AWS data stack (S3, Athena, EKS) and partner with DevOps to meet requirements.
• Review PRs and enforce code quality; guide senior developers.

Conocimientos

ETL pipelines

OLAP architecture

Data lake

Airflow

Python

REST/GraphQL

Docker

PostgreSQL

Kubernetes

English

Herramientas

Airflow

Docker

PostgreSQL

Kubernetes

Athena

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will design ETL pipelines, orchestrate with Airflow, and drive the AWS data stack including S3, Athena, and EKS, while guiding a team of senior developers.

You will work across OLAP workloads, data lake on object storage, and collaborate with DevOps to ensure performance, reliability, and maintainability.