Databricks Architect — Lead Cloud Data Platform (Remote)

Cuesta Partners, LLC; United States; Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Flexible location

Healthcare benefits

401k

Paid time-off

Job summary

Cuesta Partners is seeking a Databricks Architect to lead production-grade data platforms for enterprise clients. This hands-on leadership role requires working with C-level stakeholders to design scalable Databricks solutions across AWS and Azure.

You will guide end-to-end data pipelines, implement CI/CD, and mentor data engineering teams while ensuring governance and best practices. Local and client-location flexibility is offered.

Qualifications

• 6+ years in Data Engineering or Cloud Architecture.
• 3+ years hands-on Databricks experience.
• Strong PySpark, Spark SQL, Python and SQL skills.
• Deep Delta Lake/Unity Catalog experience and governance.
• Experience delivering Databricks projects in consulting/Professional Services.

Responsibilities

• Design and architect scalable Databricks-based solutions for enterprise clients.
• Lead end-to-end cloud data platform implementations on AWS and/or Azure.
• Build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Partner with client stakeholders to translate business needs into technical designs.
• Provide technical leadership to data engineering teams.
• Implement CI/CD and IaC for Databricks resources.
• Drive collaborative development with Git workflows and code reviews.
• Collaborate cross-functionally with analytics, engineering, and business teams.
• Serve as the primary technical point of contact for clients, including C-level executives.

Skills

Databricks

PySpark

SQL

Git

Communication

Tools

Delta Lake

Unity Catalog

Delta Live Tables

Terraform

GitHub Actions

Job description

Cuesta Partners is seeking a Databricks Architect to lead production-grade data platforms for enterprise clients. This hands-on leadership role requires working with C-level stakeholders to design scalable Databricks solutions across AWS and Azure.

You will guide end-to-end data pipelines, implement CI/CD, and mentor data engineering teams while ensuring governance and best practices. Local and client-location flexibility is offered.