Databricks Architect — Lead Data Platform Delivery (Remote)

Cuesta Partners; Medellín; On-site; COP 223,200,000 - 357,120,000; Full time

Benefits offered by this job

Comprehensive Health Plan

Hybrid work model

Annual performance bonus

Career growth

Team engagement activities

Paid time off

Job summary

Cuesta Partners is seeking a Databricks Architect to lead the delivery of data engineering solutions for enterprise clients. This hands-on leadership role collaborates with C-level stakeholders to design, build, and deploy production-grade Databricks platforms.

The position is remote with occasional travel to the United States. You must be located in Colombia (Medellín, Bogotá, Barranquilla or Cali) to coordinate with local teams and clients.

Qualifications

• 6+ years of experience in data engineering or cloud architecture.
• 3+ years hands-on experience with Databricks.
• Strong proficiency in PySpark, Spark SQL, Python and SQL.
• Experience delivering Databricks projects in consulting.
• Experience with data lake concepts and governance.

Responsibilities

• Design and architect scalable Databricks-based solutions for enterprise clients.
• Lead end-to-end cloud data platform implementations across AWS and/or Azure.
• Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows.
• Partner directly with client stakeholders to translate business needs into technical solutions.
• Provide technical leadership and guidance to data engineering teams.
• Implement CI/CD pipelines and infrastructure-as-code for Databricks resources.
• Drive collaborative development through Git workflows, pull requests, and code reviews.
• Collaborate cross-functionally with analytics, engineering, and business teams.
• Serve as the primary technical point of contact for clients, including C-level executives.

Skills

6+ years data engineering experience

3+ years Databricks hands-on

Client-facing / consulting experience

Team leadership / mentoring

Strong PySpark/Spark SQL/Python

SQL proficiency

Tools

Databricks

Delta Lake

Unity Catalog

Delta Live Tables

Spark

PySpark

Python

SQL

Terraform

Git/GitHub Actions

MLflow

Job description

Cuesta Partners is seeking a Databricks Architect to lead the delivery of data engineering solutions for enterprise clients. This hands-on leadership role collaborates with C-level stakeholders to design, build, and deploy production-grade Databricks platforms.

The position is remote with occasional travel to the United States. You must be located in Colombia (Medellín, Bogotá, Barranquilla or Cali) to coordinate with local teams and clients.