Enterprise Databricks Lakehouse Architect (Remote)

CloudTech Innovations; United States; On-site; USD 138,000 - 234,000; Full time

Job summary

CloudTech Innovations seeks an experienced Data Engineer RSA focused on Databricks Lakehouse to join client delivery teams as a hands-on architect. You will translate complex business needs into scalable data solutions and provide technical leadership across engagements.

The role embeds you with client teams, leading architecture, design, and CI/CD pipelines, with emphasis on Unity Catalog, DLT, and large-scale production workloads across AWS/Azure/GCP.

Qualifications

• Experience with Unity Catalog, DLT, and Lakehouse Federation in production systems.
• Proven ability to design and implement CI/CD pipelines for data platforms.
• Strong Terraform and version-control workflow experience.
• Expertise in Spark (PySpark/Scala) and pipeline automation (Airflow/dbt).
• Hands-on cloud experience across AWS/Azure/GCP, containers (Docker).
• Experience with real-time streaming (Kafka/Kinesis).

Responsibilities

• Lead technical priorities across multiple enterprise client engagements with scalable architecture.
• Architect and maintain CI/CD pipelines for Databricks assets and data workflows.
• Serve as the technical advisor within client delivery teams and mentor engineers.
• Design and optimize Databricks Lakehouse platforms using Medallion Architecture.
• Own end-to-end development lifecycle from ETL/ELT to deployment and production support.
• Implement governed Lakehouse patterns with Unity Catalog, RBAC/ABAC, and lineage.
• Design integration across AWS/Azure/GCP and enterprise systems.
• Lead architecture reviews and drive cloud cost optimization.

Skills

Unity Catalog

Delta Live Tables

Photon Engine

Lakehouse Federation

CI/CD pipelines

Terraform

Spark PySpark/Scala

Airflow/dbt

AWS/Azure/GCP

Kafka/Kinesis

Tools

GitHub Actions

Azure DevOps

Jenkins

dbt

FastAPI/Flask/Node.js

Job description

CloudTech Innovations seeks an experienced Data Engineer RSA focused on Databricks Lakehouse to join client delivery teams as a hands-on architect. You will translate complex business needs into scalable data solutions and provide technical leadership across engagements.

The role embeds you with client teams, leading architecture, design, and CI/CD pipelines, with emphasis on Unity Catalog, DLT, and large-scale production workloads across AWS/Azure/GCP.