Senior Data Engineer — Scalable Data Platform (Remote)

AgileEngine, LLC.; Pereira; Híbrido; COP 388.878.086 - 486.097.608; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

Exciting projects

Flextime

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to architect, build, and scale a modern data platform—designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices.

You will orchestrate workflows using Airflow, Prefect, or Dagster; ingest data from REST APIs and event-driven sources; and apply CI/CD, Docker, and IaC to data repositories with a strong emphasis on reliable, well-tested Python code.

Formación

• 4+ years of experience as a Data Engineer.
• Proficiency in Python, with modular, maintainable and well-tested code.
• Advanced knowledge of SQL, query optimization, database design principles and normalization/denormalization.
• Hands-on experience with Snowflake.
• Production experience with workflow orchestration tools such as Apache Airflow, Prefect, or Dagster.
• Experience working with REST APIs, event-driven architectures, and batch and streaming pipelines.
• Experience implementing automated data quality checks, data lineage, and alerting mechanisms.
• Strong experience with Git, Docker, CI/CD automation, and Infrastructure-as-Code fundamentals.

Responsabilidades

• Design, build, and maintain reliable, scalable ETL/ELT workflows that process batch and streaming data from diverse sources.
• Design production-ready normalized and denormalized schemas in Snowflake to optimize query performance and support enterprise analytics.
• Connect and ingest data from third-party REST APIs, event-driven streams, and batch sources into core data storage platforms.
• Maintain and expand workflow orchestration pipelines using Airflow, Prefect, or Dagster.
• Implement automated data testing, validation, lineage tracking, and proactive alerting frameworks to ensure data accuracy and system uptime.
• Drive CI/CD best practices, maintain codebases using Git and Docker, and adopt Infrastructure-as-Code patterns.
• Apply modern software engineering standards, including design patterns, automated unit and integration testing, and clear documentation.

Conocimientos

4+ years of experience as a Data Engin

Python

SQL

REST APIs

event-driven architectures

data quality checks

data lineage

alerting mechanisms

Git

Docker

CI/CD automation

Infrastructure-as-Code

Herramientas

Snowflake

Apache Airflow

Prefect

Dagster

Git

Docker

CI/CD

Terraform

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to architect, build, and scale a modern data platform—designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices.

You will orchestrate workflows using Airflow, Prefect, or Dagster; ingest data from REST APIs and event-driven sources; and apply CI/CD, Docker, and IaC to data repositories with a strong emphasis on reliable, well-tested Python code.