Senior Data Engineer ID88015

AgileEngine; Pereira; Presencial; COP 120.000.000 - 240.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Flextime

Descripción de la vacante

AgileEngine is an Inc. 5000 company that builds award-winning software for Fortune 500 brands and startups across 17+ industries. We are seeking a Senior Data Engineer to lead replacing a third-party ingestion tool with a custom ETL pipeline in our AWS environment.

You will document existing logic, evaluate buy-vs-build options such as Fivetran, and design a standalone pipeline that powers client dashboards while coordinating with data science teams and the Infrastructure Lead.

Formación

• 4+ years in SQL and large-scale data ingestion/pipeline.
• Direct or adjacent experience with digital advertising/DSP data.
• Experience with AWS data services (RDS/Postgres, S3, ECS).
• Ability to contribute to application/back-end work beyond ETL.
• Familiarity with ELT tools like Fivetran.
• Ability to align ingestion output with downstream dashboards.

Responsabilidades

• Document current ingestion logic in the legacy tool (TapClicks).
• Build the ETL pipeline to replace the legacy system within AWS.
• Evaluate buy-vs-build options (e.g., Fivetran) with the Infra Lead.
• Design a standalone owned pipeline to power client dashboards.
• Provide backend support within the AWS environment as needed.
• Coordinate with data science teams to align ingestion with models.

Conocimientos

Strong SQL

ETL pipelines

Data ingestion

DSP data experience

AWS data services

Backend integration

Fivetran evaluation

English (Upper-Interm)

Herramientas

TapClicks

Amazon DSP / Advertising API

AWS ECS/S3/RDS

Fivetran

Descripción del empleo

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

We are looking for a Senior Data Engineer to lead the replacement of a third-party digital ingestion tool with a custom-built ETL pipeline. This person will document existing logic, evaluate build-vs-buy options such as Fivetran, and build a standalone pipeline within an existing AWS environment. Strong SQL and DSP or programmatic advertising experience are central to this role.

WHAT YOU WILL DO

• Document current ingestion logic inside the legacy tool (TapClicks), including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
• Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and custom-built ETL systems alongside the Infrastructure Lead.
• Design the pipeline as a standalone, owned system to power client-facing dashboards.
• Provide flexible engineering support for application and backend work within the AWS environment when directed.
• Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
• Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.

MUST HAVES

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).
• Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment.
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.
• Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
• Upper-intermediate English level.

NICE TO HAVES

• Experience replacing legacy third-party data pipelines with owned, custom infrastructure.
• Familiarity with MLOps pipelines and how data feeds predictive models.
• Experience working alongside part-time technical advisory leads to validate architecture decisions.

PERKS AND BENEFITS

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.