A complete application in a minute
Tailored resume and cover letter, ready to send.
AgileEngine is seeking a Senior Data Engineer to replace a third-party data ingestion tool with an owned ETL pipeline. You will work across AWS services and data sources to design, build, and maintain scalable ingestion processes.
The role emphasizes collaboration with data science and backend teams, containerized infrastructure on ECS, and hands-on development extending beyond ETL to support analytic dashboards.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
ABOUT THE ROLE
We are looking for a Senior Data Engineer to replace a third-party data ingestion tool with an owned ETL pipeline.
MUST HAVES
NICE TO HAVES
WHAT YOU WILL DO
- Document current ingestion logic inside the legacy tool, including sources, endpoints, schemas, and transformation logic.
- Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
- Evaluate and decide between off-the-shelf solutions and owned ETL systems alongside the Infrastructure Lead.
- Design the pipeline as a standalone, owned system to power client-facing dashboards.
- Provide flexible engineering support for application and backend work within the AWS environment when directed.
- Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
- Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.
PERKS AND BENEFITS