Databricks Architect | Latam

Cuesta Partners; Perímetro Urbano Barranquilla; Presencial; COP 90.000.000 - 140.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health plan

Team events

Annual performance bonus

Career growth

Remote work flexibility

PTO & holidays

Descripción de la vacante

Cuesta Partners is seeking a Databricks Architect to lead data engineering delivery in a client-facing role. You will design, build, and deploy production-grade Databricks platforms across AWS and/or Azure, guiding teams and collaborating with C-level stakeholders.

This remote role may require occasional US travel for critical sessions. You must be located in Colombia. Strong PySpark, Delta Lake, Unity Catalog, and MLflow experience are expected.

Formación

• 6+ years in data engineering or cloud architecture.
• 3+ years hands-on with Databricks.
• Strong PySpark, Spark SQL, Python and SQL skills.
• Deep Delta Lake, Unity Catalog, Delta Live Tables and Databricks Jobs experience.
• Consulting or professional services delivery experience.
• Solid data lake knowledge and formats (Delta, Iceberg, Parquet).
• Experience designing Unity Catalog governance and lineage.
• Familiar with medallion bronze/silver/gold patterns.
• Hands-on Git version control, PRs and code reviews.
• CI/CD and IaC for Databricks (Terraform, GitHub Actions).
• MLflow: experiment tracking, model registry, deployment, observability.
• Cloud platform experience and client-facing work.
• Experience leading technical projects or mentoring teams.

Responsabilidades

• Design and architect Databricks-based solutions for enterprise clients.
• Lead end-to-end cloud data platform implementations AWS and/or Azure.
• Build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Design ETL/ELT pipelines with Spark, PySpark and Databricks Workflows.
• Collaborate with client stakeholders to translate business needs into technical solutions.
• Provide technical leadership to data engineering teams.
• Implement CI/CD and IaC for Databricks resources.
• Drive development with Git workflows, PRs, and code reviews.
• Work with analytics, engineering and business teams cross-functionally.
• Serve as primary technical contact for clients including C-level executives.

Conocimientos

Data Engineering

Cloud Architecture

Databricks

PySpark

Spark SQL

Python

SQL

Delta Lake

Unity Catalog

Delta Live Tables

Databricks Jobs

Git

GitHub Actions

Terraform

MLflow

Herramientas

Git

GitHub Actions

Terraform

Descripción del empleo

About Cuesta Partners We are looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment. This is a hands-on leadership role where you will work directly with clients — including C-level stakeholders — to design, build, and deploy production-grade Databricks platforms.

While the role is remote, occasional though infrequent travel to the United States may be required for some critical sessions.

You MUST BE located in Colombia (Bogotá, Medellin, Barranquilla or Cali)

What You’ll Do

• Design and architect scalable Databricks-based solutions for enterprise clients.
• Lead end-to-end cloud data platform implementations across AWS and/or Azure.
• Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows.
• Partner directly with client stakeholders to understand business needs and translate them into technical solutions.
• Provide technical leadership and guidance to data engineering teams.
• Implement CI/CD pipelines and infrastructure-as-code for Databricks resources.
• Drive collaborative development through Git workflows, pull requests, and code reviews.
• Collaborate cross-functionally with analytics, engineering, and business teams.
• Serve as the primary technical point of contact for clients, including C-level executives.

What We’re Looking For

• 6+ years of experience in Data Engineering, Cloud Architecture, or related roles.
• 3+ years of hands-on experience with Databricks.
• Strong proficiency in PySpark, Spark SQL, Python, and SQL.
• Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs.
• Proven experience delivering Databricks projects in a consulting or professional services environment.
• Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.).
• Experience designing and managing Unity Catalog for governance, access control, and lineage.
• Familiarity with medallion architecture (bronze/silver/gold) patterns.
• Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows.
• CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions).
• MLflow experience: experiment tracking, model registry, deployment, and observability.
• Cloud platform experience.
• Experience working in client-facing, consulting, or cross-functional environments.
• Experience leading technical projects or mentoring engineering teams.

Nice to Have

• Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional).
• Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows.

Why You’ll Love Working With Us

• Comprehensive Health Plan: Prepaid health coverage for you and your immediate family.
• Team Engagement Activities: Fun and meaningful events to connect and grow together.
• Annual Performance Bonus: Recognition and reward for your hard work.
• Growth Opportunities: Career development and advancement within the company.
• Flexible Work: Hybrid model with mostly remote work and one day per week in the office for team connection.
• Paid Time Off & Holidays: Generous leave to recharge and spend time with loved ones.

…and more! Additional perks and initiatives to make your experience at Cuesta Partners even better.