Databricks Lakehouse Architect | Data Platform

Pyramid Consulting, Inc; Mexico; On-site; MXN 700,000 - 1,100,000; Full time

Job summary

Pyramid Consulting, Inc. seeks a senior data engineer focused on Databricks Lakehouse platforms in Mexico. You will design end-to-end data architectures across Bronze, Silver, and Gold layers, optimize large Spark jobs, and implement robust data governance using Unity Catalog and RBAC.

You should master SQL with Python or Scala, tune performance, and handle cloud infrastructure like ADLS/S3 with IAM roles. Exposure to GenAI and CI/CD is a plus.

Qualifications

• End-to-end data architectures (Bronze/Silver/Gold) design.
• Deep understanding of distributed Spark, tuning and caching.
• ACID, schema enforcement, time travel in Client Lake, data optimization.
• Governance design: RBAC, row/column security, data lineage.
• Cloud infra familiarity: AWS/Azure/GCP with IAM and VNet setups.
• Advanced SQL and fluency in Python or Scala.

Skills

Lakehouse Architecture

Databricks

Spark Internals

Unity Catalog

Cloud Platforms

SQL

Python/Scala

Tools

dbt

Airflow

Git (Databricks Repos)

Azure Data Factory

Job description

Pyramid Consulting, Inc. seeks a senior data engineer focused on Databricks Lakehouse platforms in Mexico. You will design end-to-end data architectures across Bronze, Silver, and Gold layers, optimize large Spark jobs, and implement robust data governance using Unity Catalog and RBAC.

You should master SQL with Python or Scala, tune performance, and handle cloud infrastructure like ADLS/S3 with IAM roles. Exposure to GenAI and CI/CD is a plus.