Remote Senior Databricks Data Engineer - Lakehouse & AI

AgileEngine; Ciudad de Mendoza; Presencial; ARS 181.813.000 - 272.719.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Descripción de la vacante

AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design, build, and operate batch and streaming data pipelines using PySpark, Delta Lake, and Databricks Workflows.

You will model a medallion architecture for analytics, reporting, and ML while migrating legacy workloads with validated data parity and minimal disruption. Collaboration with DevOps and analytics teams is essential.

Formación

• 4+ years of professional data engineering experience with Spark and cloud data architectures
• Hands-on with Databricks, PySpark, and Delta Lake
• Advanced SQL and Python with dimensional and Lakehouse modeling
• Experience with Structured Streaming, Auto Loader, Kafka, or Event Hubs
• Experience with Databricks Workflows, Airflow, or Azure Data Factory
• Familiarity with Unity Catalog, data governance, and PII handling
• Experience with dbt or similar transformation framework
• Upper-intermediate English level

Responsabilidades

• Design, build, and operate batch and streaming data pipelines on Databricks with PySpark and Delta Lake
• Model and maintain a medallion architecture for analytics, reporting, and ML
• Migrate legacy ETL workloads to Lakehouse with minimal disruption
• Use Claude or Copilot to accelerate development and generate tests/documentation
• Write clean Python and SQL with strong code review and documentation
• Optimize Spark jobs and Delta tables for performance and cost
• Implement data quality, lineage, and governance with Unity Catalog
• Debug, troubleshoot, and resolve pipeline failures and production incidents
• Collaborate in Agile or product-centric delivery with cross-functional teams
• Work with DevOps, platform, and analytics engineers on observability and security

Conocimientos

Databricks

Apache Spark (PySpark)

Delta Lake

SQL

Python

Structured Streaming

Kafka

Event Hubs

Unity Catalog

dbt

English

Herramientas

Databricks Workflows

Airflow

Azure Data Factory

Terraform

PostgreSQL

Dynatrace

CloudWatch

Databricks system tables

Descripción del empleo

AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design, build, and operate batch and streaming data pipelines using PySpark, Delta Lake, and Databricks Workflows.

You will model a medallion architecture for analytics, reporting, and ML while migrating legacy workloads with validated data parity and minimal disruption. Collaboration with DevOps and analytics teams is essential.