Senior Data Engineer - Build DSP ETL Pipelines (Remote)

AgileEngine; Capital; Híbrido; COP 373.680.000 - 560.521.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

Exciting projects

Flextime

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to lead replacing a third-party digital ingestion tool with a custom ETL pipeline within an existing AWS environment. You will document current logic and build a standalone, owned pipeline to support client-facing dashboards.

Key responsibilities include evaluating build-vs-buy options like Fivetran, collaborating with data science, and ensuring ingestion aligns with downstream attribution and scoring models.

Formación

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).
• Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment.
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.
• Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
• Upper-intermediate English level.

Responsabilidades

• Document current ingestion logic inside the legacy tool (TapClicks), including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
• Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and custom-built ETL systems alongside the Infrastructure Lead.
• Design the pipeline as a standalone, owned system to power client-facing dashboards.
• Provide flexible engineering support for application and backend work within the AWS environment when directed.
• Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
• Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.

Conocimientos

SQL

Data ingestion

DSP data

AWS data services

Backend work

Fivetran evaluation

English Proficiency

Herramientas

Fivetran

AWS (RDS/Postgres, S3, ECS)

ECS

S3

RDS/Postgres

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to lead replacing a third-party digital ingestion tool with a custom ETL pipeline within an existing AWS environment. You will document current logic and build a standalone, owned pipeline to support client-facing dashboards.

Key responsibilities include evaluating build-vs-buy options like Fivetran, collaborating with data science, and ensuring ingestion aligns with downstream attribution and scoring models.