Remote Data Engineer: Databricks Lakehouse & AI Pipelines

INGEPSY; Medellín; Presencial; COP 279.616.000 - 466.027.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

100% remote work

Annual learning budget

Competitive compensation

Descripción de la vacante

AgileEngine is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You’ll build batch and streaming pipelines with PySpark/Delta Lake, using a medallion architecture (bronze/silver/gold) for analytics and ML use cases.

You’ll leverage Claude and GitHub Copilot to accelerate development, ensure data quality, governance, and scalable data platforms for enterprise customers worldwide. Remote work is supported.

Formación

• 3+ years of data engineering with Spark
• Experience with Databricks, PySpark, Delta Lake
• Advanced SQL and Python
• Experience with streaming using Structured Streaming or Kafka
• Familiarity with Unity Catalog or data governance
• English level: upper-intermediate

Responsabilidades

• Design, build and operate batch and streaming pipelines on Databricks
• Model and maintain bronze/silver/gold medallion architecture
• Migrate legacy ETL workloads to Lakehouse
• Write clean Python and SQL with tests
• Collaborate with DevOps and analytics teams

Conocimientos

Databricks

PySpark

SQL

Python

Data modeling

English

Streaming

Cloud data warehouse

Problem solving

Communication

Herramientas

Databricks

Airflow

Terraform

dbt

Azure Data Factory

Descripción del empleo

AgileEngine is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You’ll build batch and streaming pipelines with PySpark/Delta Lake, using a medallion architecture (bronze/silver/gold) for analytics and ML use cases.

You’ll leverage Claude and GitHub Copilot to accelerate development, ensure data quality, governance, and scalable data platforms for enterprise customers worldwide. Remote work is supported.