Senior Databricks Engineer: Data Lakehouse & Pipelines

Agileengine; Córdoba; Híbrido; ARS 181.094.000 - 271.641.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

A selection of exciting projects

Flextime

Descripción de la vacante

AgileEngine is hiring a Senior Data Engineer to design, build, and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake. The role focuses on migrating legacy ETL workloads to a governed Lakehouse with medallion architecture, enabling analytics and AI use cases.

You will write clean Python and SQL, optimize Spark jobs, and implement data governance and quality checks. Strong collaboration with DevOps and analytics teams is essential.

Formación

• 3+ years of professional data engineering experience.
• Hands-on with Databricks, Spark PySpark, and Delta Lake.
• Advanced SQL and Python with data modeling skills.
• Experience with streaming ingestion using Kafka, Event Hubs or similar.
• Experience with workflow orchestration (Databricks Workflows, Airflow, or Azure Data Factory).
• Experience with legacy platform migrations and ETL modernization.
• Familiarity with Unity Catalog and data governance.

Responsabilidades

• Design, build, and operate batch and streaming pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows.
• Model and maintain a medallion architecture serving analytics and ML consumers.
• Migrate legacy ETL and data warehouse workloads onto the Lakehouse with validated data parity.
• Write clean, well-tested Python and SQL; maintain code quality and docs.
• Optimize Spark jobs and Delta tables for performance and cost.
• Implement data quality, lineage, and governance using Unity Catalog.
• Collaborate with DevOps, platform, and analytics engineers on observability and security.

Conocimientos

Apache Spark

Databricks

PySpark

Delta Lake

SQL

Python

Data modeling

Data governance

Cloud architectures

Communication

Herramientas

Databricks Workflows

Airflow

Azure Data Factory

dbt

Unity Catalog

Descripción del empleo

AgileEngine is hiring a Senior Data Engineer to design, build, and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake. The role focuses on migrating legacy ETL workloads to a governed Lakehouse with medallion architecture, enabling analytics and AI use cases.

You will write clean Python and SQL, optimize Spark jobs, and implement data governance and quality checks. Strong collaboration with DevOps and analytics teams is essential.