Senior Databricks Lakehouse Architect

Apex Systems; México; On-site; MXN 900,000 - 1,200,000; Full time

Job summary

Apex Systems is seeking a Senior Databricks Engineer to lead the design and implementation of a modern Databricks Lakehouse architecture. You will migrate legacy data solutions into scalable, governed pipelines using Databricks, PySpark, and Delta Lake.

You will define and build Bronze, Silver, and Gold data layers to enable both batch and near real-time processing, while guiding and mentoring junior engineers and collaborating with data teams and stakeholders.

Qualifications

• 6+ years of experience in data engineering, with 3+ years of hands-on Databricks experience.
• Strong expertise in PySpark, Spark SQL, and Delta Lake.
• Proven experience migrating legacy data platforms such as SQL Server, SSIS, and ADF.

Responsibilities

• Architect and implement end-to-end data solutions within the Databricks Lakehouse environment.
• Design and build ingestion, transformation, and serving pipelines using PySpark, Spark SQL, and Delta Lake.
• Establish medallion architecture practices across Bronze, Silver, and Gold layers.

Skills

Databricks experience

Data engineering

Leadership

Mentoring

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems

Tools

PySpark

Spark SQL

Delta Lake

Azure SQL

SSIS

ADF

Unity Catalog

Job description

Apex Systems is seeking a Senior Databricks Engineer to lead the design and implementation of a modern Databricks Lakehouse architecture. You will migrate legacy data solutions into scalable, governed pipelines using Databricks, PySpark, and Delta Lake.

You will define and build Bronze, Silver, and Gold data layers to enable both batch and near real-time processing, while guiding and mentoring junior engineers and collaborating with data teams and stakeholders.