Senior Data Engineer - Remote, Flexible Hours, Growth

AgileEngine; Centrosur; Presencial; COP 120.000.000 - 190.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth architecture for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

This role requires strong autonomy as it operates without dedicated QA during the initial build phase.

Formación

• 5+ years of heavy Data Engineering or Backend experience focused on data pipelines and infrastructure.
• Expert-level Python skills, building containerized microservices and workers (ECS/EKS).
• Deep experience with AWS data infrastructure, specifically S3, AWS Glue, and Amazon Athena.
• Experience integrating AI APIs, specifically AWS Bedrock, Claude, or Gemini.
• High comfort level in Mac/Linux terminal (Bash, Makefiles).
• Strong communication and interview skills for technical assessments.
• Ability to handle cross-team dependencies with DevOps provisioning.
• Proficiency with AI-assisted development tools and agentic coding workflows.
• Upper-intermediate English level.

Responsabilidades

• Construct the core ingestion pipelines to pull high-volume metrics from the YouTube Data API, YouTube Creator API, Google Trends, and Later Social into the AWS S3/Glue/Athena SSoT.
• Write and maintain containerized Python workers (RQ/Celery with Redis) on EKS to handle data processing.
• Work directly with the Bedrock LLM layer and internal SDKs to ensure data flows into the AI orchestration/scoring layer.
• Extend existing Python SDKs (e.g., gads-audience-insights) to cover new services like the ContentCreatorInsightsService.
• Own the User Acceptance Testing (UAT) for the data layer, ensuring high quality and catching edge cases without a dedicated QA team.
• Work alongside internal DevOps/platform teams for CI/CD (GitHub Actions, ArgoCD) and IaC (Terraform).

Conocimientos

5+ years data engineering

Python

Containerized microservices

AWS data infrastructure

Data pipelines

ECS/EKS

Bedrock / AI APIs

Mac/Linux terminal

English (upper-intermediate)

AI-assisted development tools

CI/CD tooling

Herramientas

GitHub Actions

ArgoCD

Terraform

ECS

EKS

AWS Glue

Amazon Athena

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth architecture for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

This role requires strong autonomy as it operates without dedicated QA during the initial build phase.