Senior Data Engineer

AgileEngine; Colombia; Remote; COP 90,000,000 - 160,000,000; Full time

Job summary

AgileEngine is seeking a Senior Data Engineer to lead the replacement of a legacy ingestion tool with a custom ETL pipeline in an AWS environment. You will document existing logic, evaluate Fivetran vs build options, and build a standalone pipeline to power client dashboards.

You will work cross-functionally with data science and backend teams, supporting ingestion across Amazon API and DSP data sources, while maintaining a remote-friendly, flexible schedule.

Qualifications

• 4+ years of SQL and large-scale data ingestion/pipeline experience.
• Direct or adjacent experience with digital advertising / DSP data.
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS).
• Ability to contribute to application and backend work beyond ETL.
• Familiarity with managed ELT tools such as Fivetran.
• Ability to ramp into attribution and scoring logic.
• Growth mindset with mentorship and learning opportunities.
• Flexible, remote-friendly working style.

Responsibilities

• Document current ingestion logic inside the legacy tool (TapClicks) including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, ingesting from the Amazon API and DSP data sources.
• Evaluate off-the-shelf vs custom-built ETL options with Infrastructure Lead.
• Design a standalone, owned pipeline to power client dashboards.
• Provide engineering support for AWS-based backend work as needed.
• Coordinate with data science teams to align ingestion with downstream models.

Skills

SQL

Data ingestion

DSP data

AWS data services

ETL pipelines

Back-end work

Fivetran

Attribution & scoring

Collaboration

Remote-ready

Tools

Fivetran

AWS ECS

Amazon Advertising API

Job description

We are looking for a Senior Data Engineer to lead the replacement of a third-party digital ingestion tool with a custom-built ETL pipeline. This person will document existing logic, evaluate build-vs-buy options such as Fivetran, and build a standalone pipeline within an existing AWS environment. Strong SQL and DSP or programmatic advertising experience are central to this role.

What you will do

• Document current ingestion logic inside the legacy tool (TapClicks), including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
• Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and custom-built ETL systems alongside the Infrastructure Lead.
• Design the pipeline as a standalone, owned system to power Diray's client-facing dashboards.
• Provide flexible engineering support for MAT and the Impact Engine application and backend work within the AWS environment when directed.
• Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
• Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.

Must haves

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).
• Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment.
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.
• Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
• Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
• Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
• Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
• Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
• Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
• Well-being & support: access local well-being programs and people-focused support tailored to your location