Senior Data Engineer — Remote, Build AI-Powered Pipelines

AgileEngine, LLC.; Región Centro; Presencial; MXN 900.000 - 1.500.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth architecture for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

This role requires strong autonomy during the initial build phase. You'll construct high-volume pipelines from YouTube and social data into S3/Glue/Athena SSoT, develop Python

Formación

• 5+ years of heavy Data Engineering or Backend experience; focus on data pipelines and infra.
• Expert-level Python skills; building containerized microservices and workers (ECS/EKS).
• Deep experience with AWS data infra: S3, AWS Glue, and Amazon Athena.
• Proven hands-on experience integrating AI APIs (AWS Bedrock, Claude, Gemini) and handling external data streams.
• Comfortable in Mac/Linux terminal (Bash, Makefiles).
• Strong communication and interview skills; able to defend technical choices under a rigorous interview.
• Extreme pragmatism for cross-team dependencies (DevOps access/provisioning).
• Proficiency with AI-assisted development tools and agentic coding workflows.

Responsabilidades

• Construct core ingestion pipelines to pull data from sources into the AWS S3/Glue/Athena SSoT.
• Write and maintain containerized Python workers on EKS for data processing.
• Collaborate with Bedrock LLM layer and internal SDKs to feed AI orchestration layer.
• Extend SDKs to cover new services like ContentCreatorInsightsService.
• Own UAT for the data layer with minimal dedicated QA support.
• Collaborate with DevOps/platform teams for CI/CD (GitHub Actions, ArgoCD) and IaC (Terraform).

Conocimientos

5+ years data engineering

Python expert

AWS data infra

AI API integration

Mac/Linux terminal

Clear communication

Cross-team collaboration

Agentic coding tools

Herramientas

AWS ECS/EKS

GitHub Actions

Terraform

ArgoCD

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth architecture for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing.

This role requires strong autonomy during the initial build phase. You'll construct high-volume pipelines from YouTube and social data into S3/Glue/Athena SSoT, develop Python