Senior Data Engineer — Remote, Flexible Hours, Growth

AgileEngine; Sur; Presencial; COP 120.000.000 - 210.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

The role requires strong autonomy, as it operates without dedicated QA support during the initial build phase, and involves working with Bedrock, AWS services, and internal SDKs.

Formación

• 5+ years of heavy Data Engineering or Backend experience focused on data pipelines and infrastructure.
• Expert-level Python skills, specifically in building containerized microservices and workers (ECS/EKS).
• Deep experience with AWS data infrastructure, specifically S3, AWS Glue, and Amazon Athena.
• Proven hands-on experience integrating AI APIs, specifically AWS Bedrock, Claude, or Gemini, and handling external data sources.
• High comfort level working in a Mac/Linux terminal environment (Bash, Makefiles).
• Strong communication and interview skills; able to defend technical choices and pass a rigorous interview.
• Extreme pragmatism and patience when dealing with cross-team dependencies (DevOps access/provisioning).
• Proficiency with AI-assisted development tools and agentic coding workflows.
• Upper-intermediate English level

Responsabilidades

• Construct the core ingestion pipelines to pull high-volume metrics from YouTube Data API, YouTube Creator API, Google Trends, and Later Social into AWS S3/Glue/Athena SSoT.
• Write and maintain containerized Python workers (RQ/Celery with Redis) on EKS to handle data processing.
• Work directly with the Bedrock LLM layer and internal SDKs to ensure data flows into the AI orchestration/scoring layer.
• Extend existing Python SDKs to cover new services like ContentCreatorInsightsService.
• Own the User Acceptance Testing (UAT) for the data layer, ensuring high quality and catching edge cases without dedicated QA.
• Collaborate with DevOps/platform teams for CI/CD (GitHub Actions, ArgoCD) and IaC (Terraform) and adapt to internal standards.

Conocimientos

Python

AWS

Data pipelines

ECS/EKS

Bedrock/AI APIs

CI/CD

Unix/Linux

Communication

English

Herramientas

Terraform

GitHub Actions

ArgoCD

Redis

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

The role requires strong autonomy, as it operates without dedicated QA support during the initial build phase, and involves working with Bedrock, AWS services, and internal SDKs.