Senior Databricks Data Engineer — Remote Growth

AgileEngine, LLC.; Ciudad de Mendoza; Presencial; ARS 181.527.000 - 272.290.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers, while leveraging AI tools like Claude and GitHub Copilot.

You will design, migrate, and optimize data pipelines, ensuring data parity, governance, and efficient Spark/Delta performance across cloud-based architectures.

Formación

• 4+ years of professional experience in data engineering.
• Proficient with Apache Spark, Databricks, PySpark and Delta Lake.
• Advanced SQL and Python with strong data modeling.
• Experience with streaming ingestion and Structured Streaming, Kafka, Event Hubs.
• Experience with Databricks Workflows, Airflow or Azure Data Factory.
• Experience with legacy migrations, ETL modernization, or data hygiene.
• Familiarity with Unity Catalog and data governance.
• Experience with dbt or equivalent transformation framework.
• Knowledge of secure coding standards and security best practices.

Responsabilidades

• Design, build, and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake.
• Model and maintain a medallion architecture (bronze/silver/gold) for analytics and ML.
• Migrate legacy ETL workloads to Lakehouse with minimal disruption.
• Use Claude or Copilot to accelerate development, write tests, and document solutions.
• Write clean Python and SQL; ensure code quality via reviews and tests.
• Optimize Spark jobs and Delta tables for performance and cost.
• Implement data quality, lineage, and governance via Unity Catalog and tests.
• Debug pipeline failures, data defects, and incidents in production.
• Collaborate in Agile or product-centric delivery with sprint rituals.
• Coordinate with DevOps, platform, and analytics teams on observability and security.

Conocimientos

Apache Spark

Databricks

PySpark

Delta Lake

SQL

Python

Structured Streaming

Kafka

dbt

Unity Catalog

Data governance

Data modeling

Cloud architecture

Herramientas

Databricks Workflows

Airflow

Azure Data Factory

Terraform

PostgreSQL

Descripción del empleo

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers, while leveraging AI tools like Claude and GitHub Copilot.

You will design, migrate, and optimize data pipelines, ensuring data parity, governance, and efficient Spark/Delta performance across cloud-based architectures.