Senior Data Engineer Id82548

Agileengine; Monterrey; Presencial; MXN 900.000 - 1.800.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive compensation

100% remote with flexible hours

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to architect and optimize data pipelines using Airflow and dbt within a modern Snowflake stack. You will lead automated testing, failure alerting, and migration of ETL jobs into orchestrated workflows, ensuring zero downtime for BI tools.

The role emphasizes governance, scalable Python design, and cross-team collaboration. The ideal candidate will have 4+ years in data engineering, strong Airflow/dbt skills, and experience with Git-based CI/CD in a

Formación

• 4+ years of experience as a Data Engineer.
• Hands-on Apache Airflow/Astronomer production experience building, debugging, and managing complex DAG architectures using Python.
• dbt (Data Build Tool) expertise: strong proficiency with dbt Core architecture, macros, packages, custom materializations, CI/CD patterns (state deferral).
• Advanced Git & Data CI/CD: deployment pipelines and automated regression testing for data teams using GitHub Actions or similar.
• Production Data Engineering: solid background writing clean, maintainable Python and SQL.
• Upper-intermediate English level.

Responsabilidades

• Support bronze/silver/gold layering across Snowflake with architecture input.
• Build automated tests and failure alerting for ETL and Airflow.
• Migrate Paradime jobs into orchestrated Airflow DAGs.
• Work with data governance and access controls on PII data pipelines.
• Translate dbt schedules into scalable Airflow DAGs using Python patterns.
• Maintain integration points between Paradime and Airflow in production.
• Audit dbt codebases to reduce compute runtime and cost.
• Collaborate to adapt data stack for future AI semantic layers.
• Establish automated error handling and failure recovery across pipelines.
• Ensure no downtime or data loss for downstream BI tools during changes.

Conocimientos

Data engineering experience

Apache Airflow

dbt expertise

Git & CI/CD

Python & SQL

English (upper-intermediate)

Herramientas

Snowflake

Terraform

Docker

CloudFormation

AWS S3

Descripción del empleo

Job Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

ABOUT THE ROLE

We are looking for a Senior Data Engineer with deep Airflow and dbt expertise to support Medallion Architecture implementation, harden pipeline reliability through automated testing and failure alerting, and migrate scheduled ETL jobs into orchestrated Airflow DAGs within a modern Snowflake data stack. You will build complex DAG architectures using Python, audit dbt codebases for performance and cost optimization, maintain integration points between Paradime and Airflow, and ensure zero downtime for downstream BI tools during ongoing infrastructure changes. Eastern Time Zone overlap preferred for daily team standups.

WHAT YOU WILL DO

• Support implementation of bronze/silver/gold layering across the Snowflake warehouse, working with the Lead Data Engineer on architecture and modeling decisions.
• Build automated testing and failure alerting across Paradime (ETL) and Airflow (orchestration), including reworking select existing jobs so failures are clearly attributable.
• Migrate select schedule-based Paradime jobs into orchestrated Airflow DAGs.
• Work within established data governance and access controls when building or modifying pipelines touching PII data.
• Translate dbt transform schedules and dependencies into scalable, dynamic Airflow DAGs using modern Python design patterns (@task decorators, dynamic task mapping).
• Maintain and evolve integration points between Paradime and Airflow as both tools continue to be used in production.
• Audit dbt codebases and pipeline execution paths to identify bottlenecks, reducing compute runtime and cost.
• Partner with the Lead Data Engineer to adjust the modern data stack architecture to support future AI semantic layers and downstream consumption.
• Establish and maintain automated error handling, alerting, and failure recovery routines across the pipeline stack.
• Ensure no downtime or data loss for downstream BI (Sigma) and analytics tools during ongoing infrastructure changes.
• Take on additional data engineering priorities as assigned, based on evolving business needs.

MUST HAVES

• 4+ years of experience as a Data Engineer.
• Apache Airflow / Astronomer: Substantial hands-on production experience building, debugging, and managing complex DAG architectures using Python.
• dbt (Data Build Tool) expertise: Strong proficiency with dbt Core architecture, macros, packages, custom materializations, CI/CD patterns (state deferral), and environment configurations.
• Advanced Git & Data CI/CD: Track record building deployment pipelines and automated regression testing for data teams using GitHub Actions or similar.
• Production Data Engineering: Solid general software/data engineering background writing clean, maintainable, modular Python and SQL.
• Upper-intermediate English level.

NICE TO HAVES

• Snowflake expertise: tuning compute (warehouse sizing, query profiling, clustering), RBAC/security architecture.
• Infrastructure as Code: Terraform, Docker, or CloudFormation.
• AWS S3 experience as part of a data pipeline (e.g., staging/raw ingestion layers).
• Enterprise retail, supply chain, or inventory systems data background.

PERKS AND BENEFITS

• Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
• Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
• Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
• Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
• Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
• Well-being & support: access local well-being programs and people-focused support tailored to your location

Requirements

• +4 years of experience as Data Engineer
• Apache Airflow / Astronomer: Substantial hands-on production experience building, debugging, and managing complex DAG architectures using Python.
• dbt (Data Build Tool) Expertise: Strong proficiency with dbt Core architecture, macros, packages, custom materializations, CI/CD patterns (state deferral), and environment configurations.
• Advanced Git & Data CI/CD: Track record building deployment pipelines and automated regression testing for data teams using GitHub Actions or similar.
• Production Data Engineering: Solid general software/data engineering background writing clean, maintainable, modular Python and SQL.

Monterrey, NLE, mx