Tech Lead, Data Engineering — Remote Growth & Impact

AgileEngine; Colombia; Presencial; COP 381.607.000 - 572.410.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flextime

Professional growth

Competitive USD-based compensation

Remote work options

Descripción de la vacante

AgileEngine is seeking a Tech Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will shape partitioning, file formats, schema design, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead ETL pipelines and Airflow-driven DAGs.

You will drive the AWS data stack (S3, Athena, EKS) and collaborate with DevOps, while mentoring senior developers and upholding code quality standards.

Formación

• 7+ years of engineering experience designing ETL pipelines.
• Hands-on experience with OLAP-style analytical data architecture.

Responsabilidades

• Design and own ETL pipelines at scale.
• Make architectural decisions on partitioning, file formats, schema, and near-real-time processing for OLAP workloads.
• Own the design of scheduled batch workflows (DAGs) on the client\'s Airflow setup.
• Drive the AWS data stack (S3, Athena, EKS) and partner with DevOps.
• Review PRs and enforce code quality.
• Guide senior developers and align with engineering practices.

Conocimientos

ETL pipelines

OLAP architecture

Airflow

Python

REST

GraphQL

Docker

PostgreSQL

Mac/Linux

AI tooling

Herramientas

Airflow

Dagster

Prefect

Luigi

Step Functions

S3

EKS/Kubernetes

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

Parquet

ORC

Docker

PostgreSQL

Descripción del empleo

AgileEngine is seeking a Tech Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will shape partitioning, file formats, schema design, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead ETL pipelines and Airflow-driven DAGs.

You will drive the AWS data stack (S3, Athena, EKS) and collaborate with DevOps, while mentoring senior developers and upholding code quality standards.