Senior Databricks Data Engineer | Remote Lakehouse

AgileEngine, LLC.; Santiago del Estero; Presencial; ARS 181.527.000 - 272.290.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, applying a medallion architecture across bronze, silver, and gold layers.

Expect to work with AI tools like Claude and GitHub Copilot to speed development, while writing clean Python/SQL, performing code reviews, and ensuring governance and data quality across analytics and ML workloads.

Formación

• 4+ years of professional data engineering experience.
• Strong background with Apache Spark, PySpark, and Delta Lake.
• Advanced SQL and Python with data modeling skills.
• Experience with streaming ingestion (Kafka, Structured Streaming).
• Experience with Databricks Workflows, Airflow, or Azure Data Factory.
• Previous data warehouse migrations and Lakehouse familiarity.
• Knowledge of Unity Catalog, data governance, and PII handling.
• Familiarity with dbt or similar transformation framework.
• Secure coding practices and security-minded development.

Responsabilidades

• Design and build batch and streaming pipelines on Databricks using PySpark.
• Maintain a medallion architecture for analytics and ML consumers.
• Migrate legacy ETL workloads to a Databricks Lakehouse with parity.
• Use Claude or Copilot to accelerate development and testing.
• Write clean Python and SQL; ensure code quality through reviews.
• Optimize Spark jobs and Delta tables for cost and performance.
• Implement data quality, lineage, and governance controls.
• Debug and resolve pipeline failures and data defects in production.
• Collaborate in Agile delivery with cross-functional teams.
• Partner with DevOps and analytics to improve observability and security.

Conocimientos

Databricks

PySpark

Spark SQL

Delta Lake

Python

SQL

Structured Streaming

Airflow

Azure Data Factory

dbt

Unity Catalog

PostgreSQL

Kafka

Databricks Workflows

Terraform

GitHub Copilot

Herramientas

Databricks Workflows

Terraform

Azure DevOps

Kafka

PostgreSQL

Descripción del empleo

AgileEngine, LLC. is seeking a Senior Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, applying a medallion architecture across bronze, silver, and gold layers.

Expect to work with AI tools like Claude and GitHub Copilot to speed development, while writing clean Python/SQL, performing code reviews, and ensuring governance and data quality across analytics and ML workloads.