DATA LEAD/ Hybrid in Mexico City

Pyramid Consulting, Inc

Ciudad de México

Híbrido

MXN 1.000.000 - 2.000.000

Jornada completa

hace 8 horas

Sé de los primeros/as/es en solicitar esta vacante

Generador de candidaturas

Transforma esta oferta en una entrevista: un currículum y una carta de presentación creados pensando en lo que quiere el empleador.

Supera los filtros ATS

Descripción de la vacante

Pyramid Consulting, Inc. is seeking a senior Data Engineer to design and implement data pipelines using Databricks, Airflow, and DBT in a cloud environment.

You will contribute to data governance, quality, masking, and integration efforts, leveraging Python, SQL, and AWS, while implementing robust CI/CD practices and monitoring with Datadog.

Formación

10+ years of experience in Data Engineering / Data Platform roles.
Strong hands-on expertise with Databricks (Delta Lake, workflows, DAG), Airflow/Astronomer, Python, SQL, and AWS.

Responsabilidades

Experience implementing CI/CD frameworks (Harness, GitHub Actions, Azure DevOps).
Deep understanding of data governance, catalogs, lineage, contracts, and metadata.
Knowledge of data quality and masking techniques across enterprise platforms.
Experience with API-based integrations (e.g., entitlement systems) and monitoring/observability tools like Datadog.

Conocimientos

Data engineering expertise

CI/CD experience

Data governance

Data quality

Observability

Herramientas

Databricks

Delta Lake

Airflow

Astronomer

Python

SQL

DBT

AWS

Harness

GitHub Actions

Azure DevOps

Datadog

Descripción del empleo

o Databricks (Delta Lake, workflows, DAG)
o Apache Airflow / Astronomer
o Python, SQL, DBT, AWS
· 10+ years of experience in Data Engineering / Data Platform roles
· Strong hands-on expertise in:
- o Databricks (Delta Lake, workflows, DAG)
- o Apache Airflow / Astronomer
- o Python, SQL, DBT, AWS.
· Proven experience implementing CI/CD frameworks (Harness, GitHub Actions, Azure DevOps)
· Deep understanding of:
- o Data governance (catalogs, lineage, contracts, metadata)
- o Data quality and masking techniques
- o Enterprise data platforms and marketplace ecosystems
· Experience with API-based integrations (e.g., entitlement systems like Access Central)
· Monitoring/observability tools (e.g., Datadog).