Senior Data Engineer: Scalable Analytics & Data Lakes

AgileEngine, LLC.; Bogotá; Presencial; COP 180.000.000 - 280.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Remote work 100%

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.

You will drive partitioning strategies, file formats, schema design, and near-real-time processing for OLAP workloads built on an S3-backed data lake. The role requires autonomous problem solving, guiding a team of senior developers, and defining ETL pipelines with Airflow, AWS Athena, and EKS.

Formación

• 7+ years of engineering experience in data platforms.
• Experience with OLAP-style analytics and data lakes on object storage.
• Strong Python backend development and API work.

Responsabilidades

• Design and own ETL pipelines at scale.
• Make architectural calls on partitioning and file formats.
• Own Airflow DAG design and triggering strategy.
• Drive AWS data stack and collaborate with DevOps.
• Review PRs and enforce code quality.
• Guide senior developers and align with engineering practices.

Conocimientos

Python

REST/GraphQL

Unix/Linux

Ambiguity handling

Leadership

Herramientas

Airflow

AWS

S3/Athena

EKS/Kubernetes

Parquet/ORC

Docker

PostgreSQL

Spark SQL/Trino/Presto

Descripción del empleo

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.

You will drive partitioning strategies, file formats, schema design, and near-real-time processing for OLAP workloads built on an S3-backed data lake. The role requires autonomous problem solving, guiding a team of senior developers, and defining ETL pipelines with Airflow, AWS Athena, and EKS.