Senior Data Architect & ETL Lead (Remote)

AgileEngine; Centrosur; Presencial; COP 180.000.000 - 280.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

100% remote with flexible hours

Modern projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will decide on partitioning strategies, file formats, and near-real-time processing for OLAP workloads built on an S3-backed data lake.

Design ETL pipelines, define Airflow DAGs, and lead senior developers while upholding high code quality. Your role requires autonomy, solving underspecified problems, gathering context, and shaping the right

Formación

• 7+ years of engineering experience designing ETL pipelines for large data systems.
• Hands-on OLAP data architecture experience with Athena, Trino/Presto, or similar.
• Experience with object-storage data lakes and Parquet/ORC formats.
• Deep knowledge of DAG-style orchestration (Airflow) and AWS data stack.

Responsabilidades

• Design and own ETL pipelines at scale.
• Make architectural calls on partitioning, file formats, schema/data-type strategy, near-real-time processing.
• Own Airflow DAG design and scheduling, with collaboration from DevOps on AWS data stack.
• Review PRs and mentor senior developers; enforce code quality.

Conocimientos

ETL pipelines

OLAP architecture

Airflow

Python

AWS

REST/GraphQL

Docker

PostgreSQL

AWS Athena

Airflow DAGs

Herramientas

Airflow

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

Parquet/ORC

Docker

PostgreSQL

EKS

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will decide on partitioning strategies, file formats, and near-real-time processing for OLAP workloads built on an S3-backed data lake.

Design ETL pipelines, define Airflow DAGs, and lead senior developers while upholding high code quality. Your role requires autonomy, solving underspecified problems, gathering context, and shaping the right