Senior Data Engineer - Build AI-Driven Pipelines (Remote)

AgileEngine; Puebla de Zaragoza; Presencial; MXN 900.000 - 1.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

100% remote with flexible hours

Modern projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to own ingestion, orchestration, and the Single Source of Truth for new product modules. You will build containerized data pipelines on AWS, integrate AI APIs, and manage the data lifecycle from extraction through UAT. Autonomy is required during the initial build phase.

You'll work on high-volume data ingestion, extend SDKs, and collaborate with DevOps for CI/CD and IaC. This role offers 100% remote work with flexible hours for a distributed team.

Formación

• 5+ years in data engineering or backend with focus on pipelines and infrastructure.
• Expert-level Python for containerized microservices and workers.
• Deep experience with AWS data infra (S3, Glue, Athena).
• Hands-on AI API integration (AWS Bedrock, Claude, or Gemini).
• Strong terminal skills in Mac/Linux and bash/makefile.
• Excellent communication with the ability to defend technical choices.

Responsabilidades

• Build core ingestion pipelines pulling data from YouTube Data API, YouTube Creator API, Google Trends, and more into AWS S3/Glue/Athena SSoT.
• Write and maintain containerized Python workers on EKS for data processing.
• Work with Bedrock LLM layer and internal SDKs to ensure data flows into AI orchestration.
• Extend Python SDKs to cover new services like ContentCreatorInsightsService.
• Own UAT for the data layer in the absence of a dedicated QA team.
• Collaborate with DevOps/platform teams for CI/CD (GitHub Actions, ArgoCD) and IaC (Terraform).

Conocimientos

Python

Data Pipelines

AWS

Containerized services

Linux/macOS

Communication

Herramientas

EKS

Terraform

GitHub Actions

ArgoCD

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to own ingestion, orchestration, and the Single Source of Truth for new product modules. You will build containerized data pipelines on AWS, integrate AI APIs, and manage the data lifecycle from extraction through UAT. Autonomy is required during the initial build phase.

You'll work on high-volume data ingestion, extend SDKs, and collaborate with DevOps for CI/CD and IaC. This role offers 100% remote work with flexible hours for a distributed team.