Azure Data Engineer: Modern Etl Pipelines & Databricks

Capgemini Engineering; Buenos Aires; Remote; ARS 91,242,000 - 152,070,000; Part time

Job summary

AgileEngine is seeking a part-time Data Engineering and Infrastructure Lead to audit AWS architecture, CI/CD processes, and ETL pipeline decisions in an advisory capacity. This role weighs managed tooling against custom builds and mentors the team on engineering standards.

You will review SageMaker-based MLOps pipelines, evaluate Claude Code usage for quality, and provide early opinions on data ingestion architectures.

Qualifications

• Experience auditing AWS architectures and CI/CD processes.
• Strong knowledge of ETL/ELT design and data pipelines.
• Familiarity with SageMaker-based ML workflows is a plus.
• Mentorship and team leadership experience.

Responsibilities

• Audit AWS stack across services (ECS/ECR, RDS, S3, VPC, CloudFront).
• Recommend SDLC governance, environment separation, and release gating.
• Assess Claude Code usage for code generation and reviews.
• Evaluate ETL pipeline design and data ingestion choices.

Job description

Data Engineering & Infrastructure Lead ID88014

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

We are looking for a part-time Data Engineering and Infrastructure Lead to audit AWS architecture, CI/CD processes, and ETL pipeline decisions in an advisory capacity. This person weighs managed tooling against custom builds, reviews SageMaker-based MLOps pipelines, and mentors the team on engineering standards. Evaluating AI-assisted development workflows is part of the role.

WHAT YOU WILL DO

- Audit the current AWS architecture across live applications (MAT / Signal IQ and the Impact Engine), including ECS/ECR, RDS (Postgres), S3, VPC, CloudFront/SSO, and SageMaker-based MLOps pipeline design.

- Review the CI/CD process and end-to-end app development lifecycle, recommending SDLC governance layers (schema versioning, environment separation, release gating).

- Evaluate how the team uses Claude Code (PR generation, automated reviews, token/cost management) to confirm output meets professional engineering standards.

- Provide an early technical opinion on ETL / data-ingestion pipeline architecture (managed ELT tooling vs. custom build).

- Mentor and accelerate the day-to-day infrastructure build team, focusing on