Lead Data Engineer — Remote Data Lake & OLAP Architect

AgileEngine, LLC.; Perímetro Urbano Barranquilla; Presencial; COP 374.895.000 - 499.859.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will guide design decisions on partitioning, file formats, and near-real-time processing on an S3-backed data lake.

You will lead a team of senior developers, drive ETL governance, and shape engineering practices while collaborating with DevOps and data teams to meet performance goals.

Formación

• 7+ years of engineering experience with ETL pipelines and large-volume data systems.

Responsabilidades

• Design and own ETL pipelines for data extraction, transformation, and validation at scale.

Conocimientos

ETL pipelines

OLAP architecture

Airflow

Python (FastAPI/Flask)

AWS data stack (S3, Athena, EKS)

REST/GraphQL

Docker

PostgreSQL

Mac/Linux terminal

AI-assisted development tools

Leadership / mentorship

Problem solving in ambiguity

Herramientas

Airflow

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

Parquet/ORC

Kubernetes

Descripción del empleo

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will guide design decisions on partitioning, file formats, and near-real-time processing on an S3-backed data lake.

You will lead a team of senior developers, drive ETL governance, and shape engineering practices while collaborating with DevOps and data teams to meet performance goals.