Remote Databricks Architect — Lead Enterprise Data Platform

Cuesta Partners; Perímetro Urbano Barranquilla; Presencial; COP 90.000.000 - 140.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health plan

Team events

Annual performance bonus

Career growth

Remote work flexibility

PTO & holidays

Descripción de la vacante

Cuesta Partners is seeking a Databricks Architect to lead data engineering delivery in a client-facing role. You will design, build, and deploy production-grade Databricks platforms across AWS and/or Azure, guiding teams and collaborating with C-level stakeholders.

This remote role may require occasional US travel for critical sessions. You must be located in Colombia. Strong PySpark, Delta Lake, Unity Catalog, and MLflow experience are expected.

Formación

• 6+ years in data engineering or cloud architecture.
• 3+ years hands-on with Databricks.
• Strong PySpark, Spark SQL, Python and SQL skills.
• Deep Delta Lake, Unity Catalog, Delta Live Tables and Databricks Jobs experience.
• Consulting or professional services delivery experience.
• Solid data lake knowledge and formats (Delta, Iceberg, Parquet).
• Experience designing Unity Catalog governance and lineage.
• Familiar with medallion bronze/silver/gold patterns.
• Hands-on Git version control, PRs and code reviews.
• CI/CD and IaC for Databricks (Terraform, GitHub Actions).
• MLflow: experiment tracking, model registry, deployment, observability.
• Cloud platform experience and client-facing work.
• Experience leading technical projects or mentoring teams.

Responsabilidades

• Design and architect Databricks-based solutions for enterprise clients.
• Lead end-to-end cloud data platform implementations AWS and/or Azure.
• Build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Design ETL/ELT pipelines with Spark, PySpark and Databricks Workflows.
• Collaborate with client stakeholders to translate business needs into technical solutions.
• Provide technical leadership to data engineering teams.
• Implement CI/CD and IaC for Databricks resources.
• Drive development with Git workflows, PRs, and code reviews.
• Work with analytics, engineering and business teams cross-functionally.
• Serve as primary technical contact for clients including C-level executives.

Conocimientos

Data Engineering

Cloud Architecture

Databricks

PySpark

Spark SQL

Python

SQL

Delta Lake

Unity Catalog

Delta Live Tables

Databricks Jobs

Git

GitHub Actions

Terraform

MLflow

Herramientas

Git

GitHub Actions

Terraform

Descripción del empleo

Cuesta Partners is seeking a Databricks Architect to lead data engineering delivery in a client-facing role. You will design, build, and deploy production-grade Databricks platforms across AWS and/or Azure, guiding teams and collaborating with C-level stakeholders.

This remote role may require occasional US travel for critical sessions. You must be located in Colombia. Strong PySpark, Delta Lake, Unity Catalog, and MLflow experience are expected.