Remote Data Engineer – Databricks Lakehouse & AI Pipelines

AgileEngine, LLC.; Rosario; Presencial; ARS 68.072.000 - 98.327.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine in Rosario is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture for analytics and ML consumers.

You will migrate legacy workloads, optimize Spark jobs, and implement data governance with Unity Catalog, using AI tools to accelerate development.

Formación

• 3+ years of professional data engineering experience with Spark and cloud data architectures.
• Hands-on experience building data pipelines with Databricks, Spark (PySpark), and Delta Lake.
• Advanced SQL and Python with strong data modeling skills (dimensional and Lakehouse).
• Experience with Structured Streaming, Auto Loader, Kafka or Event Hubs.
• Experience with data workflow orchestration (Databricks Workflows, Airflow, or ADF).
• Experience with legacy platform migrations and ETL modernization.

Responsabilidades

• Design, build, and operate batch and streaming pipelines on Databricks using PySpark, Delta Lake, and Workflows.
• Model and maintain a medallion architecture (bronze/silver/gold) for analytics and ML.
• Migrate legacy ETL workloads to Lakehouse with validated data parity and minimal disruption.
• Use Claude or Copilot to accelerate development, generate scaffolding, write tests, and document solutions.
• Write clean, tested Python and SQL with strong code reviews and documentation.
• Optimize Spark jobs and Delta tables for performance and cost (partitioning, clustering, caching).
• Implement data quality, lineage, and governance with Unity Catalog and automated checks.
• Debug and resolve pipeline failures and production incidents.
• Collaborate with DevOps, platform, and analytics engineers on observability, security, and compliance.

Conocimientos

SQL

Python

Problem solving

Communication

Collaboration

Attention to detail

Herramientas

Databricks

Apache Spark (PySpark)

Delta Lake

Unity Catalog

Airflow

Azure Data Factory

Descripción del empleo

AgileEngine in Rosario is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture for analytics and ML consumers.

You will migrate legacy workloads, optimize Spark jobs, and implement data governance with Unity Catalog, using AI tools to accelerate development.