Senior Databricks Engineer — Lakehouse & AI Pipelines

AgileEngine, LLC.; Santiago de Querétaro; Presencial; MXN 1.891.000 - 2.751.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

A selection of exciting projects

Flextime

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy data workloads to a governed Lakehouse and model a medallion architecture for analytics and AI use cases.

The role requires strong SQL, Python, and experience with Unity Catalog governance. You will collaborate with DevOps and analytics engineers on observability, security, and data quality controls.

Formación

• 3+ years of professional data engineering experience.
• Strong SQL and Python programming.
• Experience with Databricks, Spark (PySpark), and Delta Lake.

Responsabilidades

• Design, build, and operate batch and streaming data pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows.
• Model and maintain a medallion architecture (bronze/silver/gold) for analytics and ML use cases.
• Migrate legacy ETL and data warehouse workloads onto Lakehouse with validated data parity and minimal disruption.

Conocimientos

3+ years data eng

Apache Spark

SQL

Python

Troubleshooting & collaboration

Herramientas

Databricks

Delta Lake

PySpark

Unity Catalog

Descripción del empleo

AgileEngine, LLC. is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy data workloads to a governed Lakehouse and model a medallion architecture for analytics and AI use cases.

The role requires strong SQL, Python, and experience with Unity Catalog governance. You will collaborate with DevOps and analytics engineers on observability, security, and data quality controls.