Remote Lead Data Engineer – OLAP, AWS Data Lake

AgileEngine, LLC.; Santiago de Querétaro; Presencial; MXN 2.042.000 - 2.893.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Lead Data Engineer to own data pipelines and analytical architecture for a high-volume marketing analytics platform.

You will shape partitioning, file formats, schema, and near-real-time processing on an S3-backed data lake, and lead senior developers with strong code quality standards. You will define DAG-based orchestration with Airflow, drive AWS data tools (Athena, EKS), and collaborate closely with DevOps to meet functional and non-functional requirements.

Formación

• 7+ years of engineering experience with ETL pipelines and data systems.
• OLAP-depth with Athena/Trino/Presto or similar.
• Data lake design on object storage with partitioning and Parquet/ORC.
• Deep knowledge of DAG-based orchestration and Airflow.
• AWS data stack experience including S3, Athena, EKS.

Responsabilidades

• Design and own ETL pipelines at scale across internal databases and external APIs.
• Make architectural calls on partitioning, file formats, and near-real-time processing for OLAP workloads.
• Own the design of scheduled batch workflows (DAGs) in Airflow and drive architecture discussions.
• Drive AWS data stack usage and collaborate with DevOps on infra decisions.
• Review PRs and enforce code quality standards.
• Guide senior developers and align with engineering practices.

Conocimientos

ETL pipelines

OLAP architecture

Python

REST/GraphQL

Airflow

AWS data stack

S3/Parquet

PostgreSQL

Docker

Mac/Linux

AI-assisted development

Leadership

Herramientas

Airflow

AWS

Docker

PostgreSQL

Kubernetes (EKS)

Athena

Trino/Presto

Parquet/ORC

Descripción del empleo

AgileEngine, LLC. is seeking a Lead Data Engineer to own data pipelines and analytical architecture for a high-volume marketing analytics platform.

You will shape partitioning, file formats, schema, and near-real-time processing on an S3-backed data lake, and lead senior developers with strong code quality standards. You will define DAG-based orchestration with Airflow, drive AWS data tools (Athena, EKS), and collaborate closely with DevOps to meet functional and non-functional requirements.