Lead Data Engineer - Remote & Analytics Architect

INGEPSY; Bogotá; Presencial; COP 286.250.000 - 508.890.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine seeks a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will shape partitioning strategy, file formats, schema design, and near-real-time processing for OLAP workloads built on an S3-backed data lake.

Lead the ETL design using Airflow, guide a team of senior developers, collaborate with DevOps on the AWS stack (S3, Athena, EKS), and drive quality through code reviews and architecture discussions.

Formación

• 7+ years of engineering experience designing and implementing ETL pipelines.
• OLAP-style analytical data architecture experience.
• Data lake on object storage with partitioning and Parquet/ORC.
• Deep familiarity with DAG-style workflow definition and triggering.
• Hands-on AWS data stack experience: S3, Athena, EKS.
• Backend proficiency in Python (FastAPI or Flask).
• REST and GraphQL experience.
• Docker and PostgreSQL experience.
• Strong English communication skills.

Responsabilidades

• Design and own ETL pipelines for scale.
• Make architectural decisions on partitioning & file formats.
• Own Airflow DAG design and triggering strategies.
• Drive AWS data stack and collaborate with DevOps.
• Review PRs and enforce code quality.
• Guide senior developers and align with client engineering practices.

Conocimientos

ETL pipelines

OLAP data architecture

Airflow

AWS data stack

Python (FastAPI/Flask)

REST/GraphQL

Docker

PostgreSQL

DAG orchestration

Mac/Linux terminal

AI-assisted development tools

English communication

Herramientas

Athena

Trino/Presto

BigQuery

Snowflake

Spark SQL

ClickHouse

Parquet/ORC

EKS/Kubernetes

Descripción del empleo

AgileEngine seeks a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will shape partitioning strategy, file formats, schema design, and near-real-time processing for OLAP workloads built on an S3-backed data lake.

Lead the ETL design using Airflow, guide a team of senior developers, collaborate with DevOps on the AWS stack (S3, Athena, EKS), and drive quality through code reviews and architecture discussions.