Lead Data Engineer — Remote, Growth & Impact

AgileEngine; Metropolitana; Presencial; COP 374.895.000 - 562.342.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Remote work

Flexible hours

Annual learning budget

Collaboration with global brands

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will decide on partitioning strategies, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead a team of senior developers to ensure code quality.

The role requires autonomy to define problems, gather context, and shape approaches, while collaborating with DevOps and analytics teams to deliver scalable

Formación

• 7+ years engineering experience with ETL pipelines and data systems.
• OLAP-style analytics architecture experience using modern data stacks.
• Experience designing data lakes on object storage with partitioning and file formats.

Responsabilidades

• Own ETL pipelines from internal databases and external APIs at scale.
• Make architectural calls on partitioning, formats and near-real-time processing for OLAP workloads.
• Design and manage Airflow DAGs and deployment considerations with DevOps.
• Drive AWS data stack usage (S3, Athena, EKS) and collaborate with teams to meet requirements.
• Review PRs and enforce code quality; guide senior developers.

Conocimientos

Airflow

Python

AWS

Data Lakes

PostgreSQL

Docker

REST/GraphQL

Big data

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Airflow

Athena

S3

EKS

Parquet/ORC

Spark SQL

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will decide on partitioning strategies, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead a team of senior developers to ensure code quality.

The role requires autonomy to define problems, gather context, and shape approaches, while collaborating with DevOps and analytics teams to deliver scalable