Lead Data Engineer — Remote, High-Impact & Growth

AgileEngine, LLC.; Metropolitana; Presencial; COP 281.171.000 - 468.618.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Descripción de la vacante

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.

You will define partitioning strategies, file formats, and near-real-time processing for OLAP workloads, and lead a team of senior developers while setting high standards for code quality.

This role requires strong autonomy, collaboration with DevOps, and a deep comfort with ambiguity.

Formación

• 7+ years of engineering experience designing and implementing ETL pipelines for large-volume data systems.
• Hands-on experience with OLAP-style analytical data architecture (Athena/Presto/BigQuery/Snowflake/Spark SQL).
• Experience with object-storage-backed data lakes (S3 or equivalent) and partitioning/file formats (Parquet/ORC).
• Deep familiarity with DAG-style workflow definition (Airflow or comparable).
• Experience with AWS data stack (S3, Athena, EKS) and collaborating with DevOps.
• Backend proficiency in Python; comfortable with REST and GraphQL APIs.
• Proficient with Docker and PostgreSQL; Mac/Linux terminal-centric environments.
• Comfort with AI-assisted development tools and responsible use in CI/CD.

Responsabilidades

• Design and own ETL pipelines at scale for internal databases and external APIs.
• Make architectural calls on partitioning, file formats, schema, and near-real-time processing for large OLAP data systems.
• Own Airflow DAG design and scheduling decisions; drive architectural discussions (not Airflow admin).
• Drive AWS data stack usage and collaborate with DevOps on requirements.
• Review PRs and enforce code quality standards.
• Guide senior developers and align with established engineering practices.

Conocimientos

ETL design

Python

Airflow

AWS

Big data

REST/GraphQL

Docker

PostgreSQL

Unix/Linux

AI tooling

Technical leadership

Ambiguity management

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Airflow

AWS data stack (S3, Athena, EKS)

Docker

Kubernetes

PostgreSQL

Descripción del empleo

AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.

You will define partitioning strategies, file formats, and near-real-time processing for OLAP workloads, and lead a team of senior developers while setting high standards for code quality.

This role requires strong autonomy, collaboration with DevOps, and a deep comfort with ambiguity.