Lead Data Engineer: Build Scalable AWS DSP ETL

AgileEngine, LLC.; Cartagena de Indias; Híbrido; COP 372.902.000 - 559.354.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to lead replacing a third-party ingestion tool with a custom ETL pipeline in an existing AWS environment. You will document legacy logic, compare build-vs-buy options like Fivetran, and build a standalone pipeline to support client dashboards.

The role requires strong SQL, DSP data exposure, and the ability to work across application and backend tasks within AWS (ECS, S3, RDS). Flexible work setup and competitive compensation are offered.

Formación

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience.
• Direct or adjacent experience with digital advertising / DSP data.
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS).
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with managed ELT tools such as Fivetran against custom builds.

Responsabilidades

• Document current ingestion logic inside the legacy tool (TapClicks), including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
• Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and custom-built ETL systems alongside the Infrastructure Lead.
• Design the pipeline as a standalone, owned system to power client-facing dashboards.
• Provide flexible engineering support for application and backend work within the AWS environment when directed.
• Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
• Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.

Conocimientos

SQL & ETL experience

DSP data experience

AWS data services

Backend/ app development

Fivetran familiarity

Attribution & scoring integration

Herramientas

Fivetran

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to lead replacing a third-party ingestion tool with a custom ETL pipeline in an existing AWS environment. You will document legacy logic, compare build-vs-buy options like Fivetran, and build a standalone pipeline to support client dashboards.

The role requires strong SQL, DSP data exposure, and the ability to work across application and backend tasks within AWS (ECS, S3, RDS). Flexible work setup and competitive compensation are offered.