Senior Data Engineer Id88015

AgileEngine; Brasília; On-site; BRL 618,000 - 926,000; Full time

Benefits offered by this job

Flex time

Growth opportunities

Competitive pay

Exciting projects

Job summary

AgileEngine is seeking a Senior Data Engineer to lead the replacement of a third-party digital ingestion tool with a custom ETL pipeline in our AWS environment. You will document current logic, evaluate Fivetran vs build, and own a standalone pipeline that feeds client dashboards.

Strong SQL and experience with DSP data and AWS data services (RDS/Postgres, S3, ECS) are essential. You’ll collaborate across teams to ensure ingestion aligns with modeling and analytics needs.

Qualifications

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience.
• Direct or adjacent experience with digital advertising / DSP data.
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS).
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran).
• Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
• Upper-intermediate English level.

Responsibilities

• Document current ingestion logic inside the legacy tool (TapClicks).
• Build the ETL pipeline to replace the legacy system.
• Evaluate between off-the-shelf solutions and custom-built ETL systems.
• Design the pipeline as a standalone, owned system for dashboards.
• Provide flexible engineering support within AWS when directed.
• Coordinate with data science teams to align ingestion with models.
• Work within the existing AWS environment (ECS, S3, RDS).

Skills

SQL

Data ingestion

DSP data

AWS services

ETL

Tools

Fivetran

ECS

S3

RDS

Job description

Descrição da vaga

Job Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

We are looking for a Senior Data Engineer to lead the replacement of a third-party digital ingestion tool with a custom-built ETL pipeline. This person will document existing logic, evaluate build-vs-buy options such as Fivetran, and build a standalone pipeline within an existing AWS environment. Strong SQL and DSP or programmatic advertising experience are central to this role.

WHAT YOU WILL DO

• Document current ingestion logic inside the legacy tool (TapClicks), including sources, endpoints, schemas, and transformation logic.
• Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
• Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and custom-built ETL systems alongside the Infrastructure Lead.
• Design the pipeline as a standalone, owned system to power client-facing dashboards.
• Provide flexible engineering support for application and backend work within the AWS environment when directed.
• Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
• Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.

MUST HAVES

• 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).
• Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).
• Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment.
• Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
• Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.
• Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
• Upper-intermediate English level.

NICE TO HAVES

• Experience replacing legacy third-party data pipelines with owned, custom infrastructure.
• Familiarity with MLOps pipelines and how data feeds predictive models.
• Experience working alongside part-time technical advisory leads to validate architecture decisions.

PERKS AND BENEFITS

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Requirements - 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design). - Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms). -Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment. -Ability to contribute to application and backend work beyond pure ETL to support broader platform needs. -Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds. -Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.