Senior Databricks Data Engineer - Remote & Growth

AgileEngine, LLC.; Región Centro; A distancia; MXN 600.000 - 1.200.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking an experienced Senior Data Engineer to modernize a 15-year data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers.

Responsibilities include migrating legacy workloads, building scalable data platforms, applying Unity Catalog governance, and collaborating with DevOps and analytics teams.

Formación

• 5+ years of professional data engineering experience.
• Strong expertise with Spark, Databricks, Delta Lake.
• Advanced SQL and Python skills.
• Experience with streaming and batch data pipelines.
• Familiarity with data governance and Unity Catalog.

Responsabilidades

• Design, build, and operate batch and streaming pipelines on Databricks using PySpark and Delta Lake.
• Model and maintain a medallion architecture (bronze/silver/gold).
• Migrate legacy ETL workloads to lakehouse with minimal disruption.
• Leverage Claude or Copilot to accelerate development and testing.
• Write clean Python and SQL, with emphasis on tests and documentation.
• Collaborate with DevOps and analytics teams on observability and security.

Conocimientos

Databricks

Apache Spark (PySpark)

Delta Lake

SQL

Python

Data modeling

Governance

Herramientas

Databricks Workflows

Airflow

Azure Data Factory

Unity Catalog

Descripción del empleo

AgileEngine is seeking an experienced Senior Data Engineer to modernize a 15-year data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers.

Responsibilities include migrating legacy workloads, building scalable data platforms, applying Unity Catalog governance, and collaborating with DevOps and analytics teams.