Remote Senior Databricks Data Engineer — Lakehouse & AI

AgileEngine, LLC.; Rosarito; Presencial; MXN 1.869.000 - 2.718.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Remote work with flexible hours

Modern projects with global teams

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to modernize a legacy data warehouse into a governed Databricks Lakehouse. You will design and operate batch and streaming pipelines with PySpark and Delta Lake, advancing analytics, reporting, and machine learning workloads.

You will collaborate with DevOps and analytics teams, apply Unity Catalog governance, and optimize Spark jobs for performance and cost. The role offers remote work and a strong growth culture.

Formación

• 4+ years of professional experience in data engineering; Spark and cloud data architectures
• Strong SQL and Python with data modeling skills
• Experience with streaming ingestion and data governance/tools like Unity Catalog
• Familiarity with Delta Lake, PySpark, and Databricks environments

Responsabilidades

• Design, build, and operate batch and streaming pipelines on Databricks with PySpark and Delta Lake
• Maintain a medallion architecture (bronze/silver/gold) for analytics and ML workloads
• Migrate legacy ETL workloads to Lakehouse with minimal business disruption
• Use Claude or Copilot to accelerate development, testing, and documentation
• Write clean Python and SQL; perform code reviews and documentation
• Optimize Spark jobs and Delta tables for performance and cost
• Implement data quality, lineage, and governance controls
• Debug and resolve pipeline failures and production incidents
• Collaborate with DevOps and analytics engineers on observability and security

Conocimientos

Databricks

Apache Spark

SQL

Python

Data modeling

Team mentoring

Herramientas

Databricks Workflows

Delta Lake

Unity Catalog

Airflow

Azure Data Factory

Kafka

dbt

Terraform

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to modernize a legacy data warehouse into a governed Databricks Lakehouse. You will design and operate batch and streaming pipelines with PySpark and Delta Lake, advancing analytics, reporting, and machine learning workloads.

You will collaborate with DevOps and analytics teams, apply Unity Catalog governance, and optimize Spark jobs for performance and cost. The role offers remote work and a strong growth culture.