Senior Databricks Data Engineer - Remote Lakehouse Impact

AgileEngine, LLC.; Mar del Plata; Presencial; ARS 181.527.000 - 242.036.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, in a medallion architecture, serving analytics and ML workloads.

You will use Claude and Copilot to speed development, write clean code, and collaborate with cross-functional teams to ensure data quality and governance across the stack.

Formación

• 4+ years of professional data engineering experience with Spark and cloud data architectures.
• Hands-on with Databricks, Spark (PySpark), and Delta Lake.
• Advanced SQL and Python with strong data modeling skills.
• Experience with streaming ingestion (Structured Streaming, Kafka, Auto Loader).
• Orchestration tools such as Databricks Workflows, Airflow or Azure Data Factory.
• Experience migrating ETL and data warehouse workloads to Lakehouse.
• Familiarity with Unity Catalog, data governance, and PII handling.
• Experience with dbt or equivalent transformation framework.
• Knowledge of secure coding practices and data security.
• Strong collaboration and ability to mentor junior engineers.

Responsabilidades

• Design, build, and operate batch and streaming pipelines on Databricks.
• Maintain medallion architecture for analytics, reporting, and ML workloads.
• Migrate legacy ETL workloads to Lakehouse with minimal disruption.
• Leverage AI tools to accelerate development and testing.
• Write clean Python and SQL; enforce code quality through reviews.
• Optimize Spark jobs and Delta tables for performance and cost.
• Implement data quality, lineage, and governance controls.
• Troubleshoot production pipelines and incidents.
• Collaborate with DevOps, platform, and analytics teams on observability and security.

Conocimientos

5+ years data engineering

Databricks

Apache Spark (PySpark)

Delta Lake

SQL

Python

Structured Streaming

Unity Catalog

dbt

Data governance

Cloud data architectures

ETL modernization

Herramientas

Databricks Workflows

Airflow

Azure Data Factory

Kafka

Auto Loader

Terraform

Descripción del empleo

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, in a medallion architecture, serving analytics and ML workloads.

You will use Claude and Copilot to speed development, write clean code, and collaborate with cross-functional teams to ensure data quality and governance across the stack.