Data Engineer: Databricks Lakehouse & AI-Driven Pipelines

AgileEngine

Monterrey

Presencial

MXN 500.000 - 700.000

Jornada completa

Hace 9 días
Generador de candidaturas

No envíes un currículum genérico: crea un currículum y una carta de presentación adaptados a este puesto concreto.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities
Remote flexibility
Competitive compensation
Modern projects
Collaborative culture
Well-being programs

Descripción de la vacante

AgileEngine is seeking a Middle Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers.

You will leverage AI tools like Claude and Github Copilot to speed up development, write clean Python/SQL, and collaborate with DevOps and analytics teams on governance and security.

Formación

  • 3+ years of data engineering experience with Spark and cloud data architectures.
  • Expertise with Databricks, Spark (PySpark), and Delta Lake.
  • Advanced SQL and Python and data modeling skills.
  • Experience with streaming ingestion and structured streaming.
  • Experience with Databricks Workflows, Airflow, or Azure Data Factory.
  • Experience migrating legacy ETL to Lakehouse and data hygiene.
  • Familiarity with Unity Catalog and data governance.
  • dbt or equivalent transformation framework experience.
  • Knowledge of secure coding standards and security best practices.
  • Experience delivering production data platforms at scale.
  • Upper-intermediate English level.

Responsabilidades

  • Design, build, and operate batch and streaming pipelines on Databricks.
  • Migrate legacy data workloads to a Databricks Lakehouse with minimal disruption.
  • Model a medallion architecture for analytics, reporting, and ML consumers.
  • Use Claude or Copilot to accelerate development, tests, and docs.
  • Write clean Python and SQL, with strong code reviews and docs.
  • Optimize Spark jobs and Delta tables for performance and cost.
  • Implement data quality, lineage, and governance with Unity Catalog.
  • Debug and resolve pipeline failures and production incidents.
  • Collaborate with DevOps, platform, and analytics engineers on observability and security.

Conocimientos

Apache Spark (PySpark)
Delta Lake
SQL
Python
Structured Streaming
Databricks Workflows
Airflow
Azure Data Factory
Unity Catalog
dbt
Terraform
Azure DevOps
PostgreSQL

Herramientas

PostgreSQL

Descripción del empleo

AgileEngine is seeking a Middle Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers.

You will leverage AI tools like Claude and Github Copilot to speed up development, write clean Python/SQL, and collaborate with DevOps and analytics teams on governance and security.

Consigue la evaluación confidencial y gratuita de tu currículum.
o arrastra y suelta tu archivo aquí
Similar jobs

Puestos de trabajo similares que vale la pena comparar

Databricks Data Engineer — Remote Lakehouse & AI Pipelines
Databricks Data Engineer — Remote Lakehouse & AI Pipelines

AgileEngine, LLC. • Rosarito

Presencial
MXN 700.000 - 1.000.000
Growth without limits
Competitive compensation
Remote with flexible hours
+3
Data Engineer - Databricks Lakehouse & Streaming Pipelines (Remote)
Data Engineer - Databricks Lakehouse & Streaming Pipelines (Remote)

AgileEngine, LLC. • León

Presencial
MXN 1.529.000 - 2.209.000
Growth without limits
Competitive compensation
Flexibility: 100% remote
Remote Data Engineer — Lakehouse, PySpark & AI-Accelerated Pipelines
Remote Data Engineer — Lakehouse, PySpark & AI-Accelerated Pipelines

AgileEngine, LLC. • Región Centro

Presencial
MXN 420.000 - 820.000
Growth without limits
Competitive compensation
Flexibility: 100% remote with flexible
+3
Data Engineer - Databricks Lakehouse & Streaming (Remote)
Data Engineer - Databricks Lakehouse & Streaming (Remote)

AgileEngine • Ciudad de México

Presencial
MXN 600.000 - 850.000
Growth opportunities
Competitive pay
Remote work
+3
Senior Databricks Data Engineer - Remote Lakehouse Excellence
Senior Databricks Data Engineer - Remote Lakehouse Excellence

AgileEngine, LLC. • Puebla de Zaragoza

Presencial
MXN 900.000 - 1.600.000
Growth without limits
Competitive compensation
Remote work with flexible hours
+3
Senior Databricks Data Engineer - Lakehouse (Remote)
Senior Databricks Data Engineer - Lakehouse (Remote)

AgileEngine • Puebla de Zaragoza

Presencial
MXN 900.000 - 1.200.000
Growth without limits
Competitive compensation
Flexibility: 100% remote with flexible
+3
Remote Senior Databricks Data Engineer — Lakehouse & AI
Remote Senior Databricks Data Engineer — Lakehouse & AI

AgileEngine, LLC. • Rosarito

Presencial
MXN 1.869.000 - 2.718.000
Growth without limits
Competitive compensation
Remote work with flexible hours
+3
Senior Databricks Data Engineer — Remote & Growth
Senior Databricks Data Engineer — Remote & Growth

AgileEngine • Monterrey

Presencial
MXN 900.000 - 1.800.000
Growth without limits
Competitive compensation
100% remote with flexible hours
+3
Senior Databricks Data Engineer — Remote, Flexible Hours
Senior Databricks Data Engineer — Remote, Flexible Hours

AgileEngine, LLC. • Monterrey

Presencial
MXN 700.000 - 1.100.000
Growth
Compensation
Remote work
+3
Senior Databricks Data Engineer - Remote & Growth
Senior Databricks Data Engineer - Remote & Growth

AgileEngine, LLC. • Región Centro

A distancia
MXN 600.000 - 1.200.000
Growth without limits
Competitive compensation
Flexibility
+3