Lead Data Engineer — Remote, Flexible Hours, Growth

AgileEngine; Pereira; Presencial; COP 288.055.306 - 480.092.178; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Remote work with flexible hours

Annual learning budget

Competitive compensation

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning strategy, file formats, schema design, and near-real-time processing for OLAP workloads on an S3-backed data lake, designing and governing ETL pipelines and Airflow DAGs.

You will drive the AWS data stack, including Athena and EKS, mentor senior developers, enforce code quality, and collaborate with DevOps to meet functional

Formación

• 7+ years of engineering experience with ETL pipelines.
• Hands-on OLAP-style analytics architecture experience.
• Proficiency with Python and REST/GraphQL.
• Experience with Airflow or similar schedulers.
• Strong AWS data stack experience (S3, Athena, EKS).
• Leadership in AI tooling and code reviews.

Responsabilidades

• Design and own ETL pipelines at scale.
• Make architectural decisions for partitioning and file formats.
• Own DAG design and scheduling on Airflow.
• Drive AWS data stack usage (S3, Athena, EKS).
• Collaborate with DevOps to meet requirements.
• Review PRs and enforce quality; mentor seniors.

Conocimientos

7+ years engineering

ETL pipelines

OLAP architecture

Python

Airflow

AWS data stack

Leadership in AI tools

English (upper-intermediate)

Herramientas

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

ClickHouse

Airflow

Dagster

Prefect

Luigi

Step Functions

EKS/Kubernetes

Docker

PostgreSQL

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will shape partitioning strategy, file formats, schema design, and near-real-time processing for OLAP workloads on an S3-backed data lake, designing and governing ETL pipelines and Airflow DAGs.

You will drive the AWS data stack, including Athena and EKS, mentor senior developers, enforce code quality, and collaborate with DevOps to meet functional