Senior Databricks Data Engineer — Remote Lakehouse

AgileEngine, LLC.; Córdoba; Presencial; ARS 166.399.000 - 242.036.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive compensation

100% remote

Modern projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine, LLC is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, aligned with a medallion architecture across bronze, silver, and gold layers.

You will leverage AI tools like Claude and GitHub Copilot to accelerate development, write Python and SQL, and optimize Spark performance while ensuring governance with Unity Catalog.

Formación

• 4+ years of professional experience in data engineering with Spark.
• Strong hands-on with Databricks, Spark (PySpark), and Delta Lake.
• Advanced SQL and Python with data modeling skills.
• Experience with streaming ingestion and orchestration tools.
• Familiarity with Unity Catalog and data governance.
• Experience migrating legacy workloads and ETL modernization.

Responsabilidades

• Design, build, and operate batch and streaming data pipelines on Databricks.
• Model medallion architecture (bronze/silver/gold) for analytics and ML.
• Migrate legacy ETL workloads with data parity and minimal disruption.
• Use Claude or Copilot to accelerate development and testing.
• Write clean Python and SQL, with strong tests and docs.
• Optimize Spark jobs and Delta tables for performance and cost.
• Implement data quality, lineage, and governance checks.
• Debug and resolve pipeline failures and production incidents.
• Collaborate in Agile delivery with DevOps and analytics teams.

Conocimientos

Spark PySpark

Delta Lake

SQL

Python

ETL

Data Warehousing

Cloud Architectures

Herramientas

Databricks

Airflow

Azure Data Factory

Kafka

Descripción del empleo

AgileEngine, LLC is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, aligned with a medallion architecture across bronze, silver, and gold layers.

You will leverage AI tools like Claude and GitHub Copilot to accelerate development, write Python and SQL, and optimize Spark performance while ensuring governance with Unity Catalog.