Remote Data Engineer - Databricks Lakehouse & Spark

AgileEngine, LLC.; Córdoba; Presencial; ARS 1.000.000 - 1.400.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Remote work with flexible hours

Meaningful modern projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine, LLC. is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.

You will also leverage AI tools like Claude and GitHub Copilot to accelerate development, implement data quality and governance, and collaborate with DevOps, platform, and analytics engineers.

Formación

• 3+ years of professional experience in data engineering with Spark
• Hands-on with Databricks, Spark (PySpark), and Delta Lake
• Advanced SQL and Python with data modeling skills
• Experience with streaming ingestion using Structured Streaming, Kafka, or Event Hubs
• Experience with workflow orchestration (Databricks Workflows, Airflow, or Azure Data Factory)
• Experience with legacy platform migrations, ETL modernization, or data hygiene
• Strong problem-solving and communication skills
• Familiarity with Unity Catalog, data governance, and PII handling
• Experience with dbt or an equivalent transformation framework
• Familiarity with secure coding standards

Responsabilidades

• Design, build, and operate batch and streaming data pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows.
• Model and maintain a medallion architecture (bronze/silver/gold) for analytics and ML.
• Migrate legacy ETL workloads onto the Lakehouse with validated data parity.
• Use Claude or Github Copilot to accelerate development, tests, and documentation.
• Write clean Python and SQL; ensure code quality via reviews and tests.
• Optimize Spark jobs and Delta tables for performance and cost.
• Implement data quality, lineage, and governance controls using Unity Catalog.
• Debug, troubleshoot, and resolve pipeline issues in production.
• Collaborate with DevOps, platform, and analytics teams on observability and security

Conocimientos

Apache Spark (PySpark)

Databricks

Delta Lake

SQL

Python

Data modeling

Structured Streaming

Kafka

Airflow

dbt

Herramientas

Databricks

Airflow

Azure Data Factory

dbt

Descripción del empleo

AgileEngine, LLC. is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.

You will also leverage AI tools like Claude and GitHub Copilot to accelerate development, implement data quality and governance, and collaborate with DevOps, platform, and analytics engineers.