Data Engineer (Databricks + Fabric)

Nir Yu; México; Remote; MXN 800,000 - 1,800,000; Full time

Job summary

Nir Yu is seeking a hands-on Data Platform Engineer in Mexico to build and run production data platforms for clients. You will design ETL/ELT pipelines in Databricks and Fabric, set up lakehouses in Delta Lake, and govern data with Unity Catalog.

You will automate deployments with CI/CD and IaC, collaborating with clients and internal teams to identify improvements and new project opportunities. The role requires hands-on Databricks and Fabric experience, advanced SQL and Python, and

Qualifications

• Hands-on Databricks in production with PySpark, Delta Lake and Unity Catalog.
• Microsoft Fabric production experience across the full platform including Lakehouse, OneLake, Data Pipelines and Gen2 notebooks.
• Advanced SQL and Python proficiency.
• Certification: DP-900 or DP-700 with plan to earn the other within 60 days (verify via Microsoft Learn).
• English B2+ and fluent Spanish.

Responsibilities

• Build and run production data platforms for clients (hands-on).
• Design and build ETL/ELT pipelines in Databricks and Fabric.
• Set up lakehouses with Bronze-Silver-Gold in Delta Lake.
• Govern data with Unity Catalog: permissions, lineage and quality.
• Automate deployments with CI/CD and infrastructure as code.
• Gather requirements with clients and cross-functional teams.
• Spot improvements that lead to new projects.

Skills

Python

SQL

PySpark

English (B2+)

Spanish (fluent)

Education

DP-900 certification

DP-700 certification

Tools

Databricks

Microsoft Fabric

Delta Lake

Unity Catalog

CI/CD / IaC

Job description

Responsibilities:

• Build and run production data platforms for our clients. This is hands-on work, not an architect who only reviews.


• Design and build ETL/ELT pipelines in Databricks and Fabric.


• Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.


• Govern data with Unity Catalog: permissions, lineage and quality.


• Automate deployments with CI/CD and infrastructure as code.


• Gather requirements with the client and with other teams.


• Spot improvements in the client's platforms that could turn into new projects.

Requirements:

• Hands-on Databricks in production. PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.


• Microsoft Fabric in production, across the full platform. Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse. A proof of concept does not count.


• Advanced SQL and Python.


• A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days. Verify it with the Microsoft Learn link.


• English B2 or higher and fluent Spanish.