Lead Data Engineer — Remote, Flexible Hours, Growth Path

AgileEngine, LLC.; Sur; Presencial; COP 281.171.000 - 468.618.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth budget

Competitive pay

Remote work

Collaborative culture

Well-being programs

Tech Talks

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytics architecture for a large-volume marketing analytics platform. You will design ETL pipelines, govern data lake schemas, and lead a senior team, working with Airflow, Athena, and AWS services.

The role emphasizes autonomy, architectural decisions, and collaboration with DevOps to deliver scalable, maintainable analytical solutions.

Formación

• 7+ years of engineering experience with ETL pipelines and data systems.
• OLAP-style data architecture experience with tools like Athena/BigQuery/Snowflake.
• Experience designing data lakes on object storage (S3 or equivalent).
• Strong DAG-based workflow design and familiarity with Airflow.
• Proficiency in Python backend development.
• Experience with REST and GraphQL APIs.
• Ability to work autonomously in ambiguous contexts.

Responsabilidades

• Design and own ETL pipelines for data from internal databases and external APIs.
• Make architectural calls on partitioning, formats, and near-real-time processing.
• Own DAG-based batch workflows on Airflow, guiding structure and triggering strategy.
• Drive AWS data stack (S3, Athena, EKS) and coordinate with DevOps.
• Review PRs and enforce code quality standards.
• Lead senior developers and uphold engineering practices.

Conocimientos

Architectural decision making

Leadership

Problem solving

Strong communication

Herramientas

Airflow

Athena

EKS/Kubernetes

Parquet/ORC

Python

REST/GraphQL

Docker

PostgreSQL

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytics architecture for a large-volume marketing analytics platform. You will design ETL pipelines, govern data lake schemas, and lead a senior team, working with Airflow, Athena, and AWS services.

The role emphasizes autonomy, architectural decisions, and collaboration with DevOps to deliver scalable, maintainable analytical solutions.