AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Senior Data Engineer to replace a third-party data ingestion tool with an owned ETL pipeline.
MUST HAVES
- 4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).
- Working knowledge of AWS data services (RDS/Postgres, S3, ECS) sufficient to build within an existing cloud environment.
- Claude Code or similar tools, and agents or MCP in real work.
- Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.
- Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.
- Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
NICE TO HAVES
- Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).
- Experience replacing legacy third-party data pipelines with owned, custom infrastructure.
- Familiarity with MLOps pipelines and how data feeds predictive models.
- Experience working alongside part-time technical advisory leads to validate architecture decisions.
WHAT YOU WILL DO
- Document current ingestion logic inside the legacy tool, including sources, endpoints, schemas, and transformation logic.
- Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.
- Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and owned ETL systems alongside the Infrastructure Lead.
- Design the pipeline as a standalone, owned system to power client-facing dashboards.
- Provide flexible engineering support for application and backend work within the AWS environment when directed.
- Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
- Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Senior Data Engineer to review the AWS architecture, CI/CD, and data pipelines of a media analytics platform, and mentor the engineering team in a part-time advisory role.
MUST HAVES
- 4+ years of deep, current hands-on experience with AWS: ECS/Fargate, ECR, RDS (Postgres), S3, SageMaker, EventBridge, VPC/ALB/CloudFront, IAM.
- Fluency in Infrastructure-as-code, specifically Terraform .
- Proven track record designing or auditing CI/CD pipelines and SDLC governance (e.g., Alembic for schema/version control, environment separation, release gating).
- Strong data engineering depth to provide defensible opinions on ETL / ingestion architecture (managed tools vs. custom builds).
- Experience evaluating AI-assisted / LLM-assisted development workflows (e.g., Claude Code) from an engineering-quality and cost-governance standpoint.
- Comfortable operating in a part-time advisory capacity (50% stepping down to 25%) as a strong communicator who can mentor less experienced engineers.
NICE TO HAVES
- Prior experience working with small, fast-moving engineering teams.
- Understanding of MLOps pipelines and data science infrastructure.
- Media/AdTech domain knowledge is helpful but not required.
WHAT YOU WILL DO
- Audit the current AWS architecture across live applications, including ECS/ECR, RDS (Postgres), S3, VPC, CloudFront/SSO, and SageMaker-based MLOps pipeline design.
- Review the CI/CD process and end-to-end app development lifecycle, recommending SDLC governance layers (schema versioning, environment separation, release gating).
- Evaluate how the team uses Claude Code (PR generation, automated reviews, token/cost management) to confirm output meets professional engineering standards.
- Provide an early technical opinion on ETL / data-ingestion pipeline architecture (managed ELT tooling vs. custom build).
- Mentor and accelerate the day-to-day infrastructure build team, focusing on AWS, DevOps, CI/CD, and data engineering practices.
- Set out recommendations and technical direction where the audit surfaces necessary changes to the current build.
- Report findings and recommendations directly to leadership, framing high-level risk and readiness.
PERKS AND BENEFITS
- Professional growth : Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects : Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime : Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
AgileEngine is an Inc. 5000 company ...
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
... (Other repeated sections omitted for brevity) ...
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
... (Remaining role details continue similarly) ...