Lead Data Engineer - Remote OLAP/Data Lake Architect

AgileEngine, LLC.; Región Centro; Presencial; MXN 900.000 - 1.200.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive pay

Remote work 100%

Challenging projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytics architecture for a large-volume marketing analytics platform built on an S3-backed data lake. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads.

You will design and govern ETL pipelines, define DAG-based orchestration with Airflow, drive the AWS data stack (Athena, EKS), and lead a team of senior developers while enforcing code quality standards.

Formación

• 7+ years of engineering experience with ETL pipelines and large-volume data systems.
• Hands-on OLAP-style analytical data architecture experience with tools like Athena/Trino/Presto/Snowflake.
• Experience with object-storage-backed data lakes (S3 or equivalent) and partitioning strategies.
• Deep familiarity with DAG-style workflow orchestration (Airflow or alternatives).
• AWS data stack exposure: S3, Athena, EKS, serverless queries.
• Backend Python development (FastAPI/Flask).
• Experience with REST and GraphQL APIs.
• Docker and PostgreSQL for transactional/application layers.
• Comfort in Mac/Linux terminal environments.
• Experience with AI-assisted development tools and responsible AI use.
• Ability to defend technical opinions and work through ambiguity.

Responsabilidades

• Design and own ETL pipelines at scale.
• Make architectural calls on partitioning, file formats, and near-real-time processing for OLAP workloads.
• Lead DAG design, dependencies, and triggering strategy in Airflow (not administering Airflow).
• Drive AWS data stack usage and collaborate with DevOps to define requirements.
• Review PRs and enforce code quality standards.
• Guide senior developers and align with engineering practices.

Conocimientos

7+ years of engineering experience

OLAP-style analytical data

Object-storage-backed data lakes

Airflow

AWS data stack

Python

REST/GraphQL

Docker

PostgreSQL

Mac/Linux

AI-assisted development tools

Ambiguity tolerance

Herramientas

Airflow

Athena

EKS/Kubernetes

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytics architecture for a large-volume marketing analytics platform built on an S3-backed data lake. You will shape partitioning, file formats, and near-real-time processing for OLAP workloads.

You will design and govern ETL pipelines, define DAG-based orchestration with Airflow, drive the AWS data stack (Athena, EKS), and lead a team of senior developers while enforcing code quality standards.