Senior Data Engineer & Analytics Architect (Remote)

AgileEngine, LLC.; Pereira; Presencial; COP 180.000.000 - 300.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Remote work 100%

Flexible hours

Meaningful projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will steer partitioning, schema design, and near-real-time processing on an S3-backed data lake, and lead a team of senior developers while upholding code quality.

Responsibilities include designing ETL pipelines, orchestrating DAGs with Airflow, and driving the AWS data stack (Athena, EKS).

Formación

• 7+ years of engineering experience with ETL pipelines and large-volume data systems.
• Hands-on with OLAP-style analytical data architecture and cloud data stacks.
• Experience designing data lakes on object storage with Parquet/ORC.
• Deep knowledge of DAG-based workflows; Airflow or comparable orchestrator.
• Experience with AWS data services (S3, Athena, EKS) and DevOps collaboration.
• Proficient in Python (FastAPI or Flask) for backend services.
• Experience with REST and GraphQL APIs.
• Docker and PostgreSQL for transactional/app layers.
• Comfortable in Mac/Linux terminal-centric environments.
• Hands-on use of AI-assisted development tools with responsible governance.
• Strong communication and ability to defend technical opinions.
• Comfort with ambiguity and solving underspecified problems.

Responsabilidades

• Own ETL pipelines for data extraction, transformation, and validation at scale.
• Make architectural calls on partitioning, file formats, and near-real-time processing for OLAP data systems.
• Own design of scheduled batch workflows (DAGs) on Airflow; define structure and dependencies.
• Drive AWS data stack usage and collaborate with DevOps.
• Review PRs and enforce code quality.
• Guide senior developers and align with established engineering practices.

Conocimientos

ETL pipelines

OLAP architecture

Object storage data lake

Airflow / DAGs

AWS data stack

Python backend

REST / GraphQL

Docker & PostgreSQL

Mac/Linux terminal

AI-assisted development tools

Ambiguity handling

Technical advocacy

Herramientas

Airflow

Kubernetes

FastAPI

Flask

Athena

Descripción del empleo

AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform. You will steer partitioning, schema design, and near-real-time processing on an S3-backed data lake, and lead a team of senior developers while upholding code quality.

Responsibilities include designing ETL pipelines, orchestrating DAGs with Airflow, and driving the AWS data stack (Athena, EKS).