Senior Databricks Architect, Data & AI Platform (Remote)

Eliassen Group; Helena (MT); Remote; USD 138,000 - 145,000; Full time

Job summary

Eliassen Group is seeking a Senior Solution Architect to lead Databricks, Data & AI modernization efforts remotely in the U.S. You will own the overall architecture, guide senior engineers, and drive governance, security, and cost‑aware platform design across the Databricks Lakehouse.

The role is hands‑on and spans enterprise architecture, platform design, and problem solving, coordinating with platform, data, security, and business teams to deliver scalable, AI‑ready data solutions.

Qualifications

• Deep knowledge of Databricks Lakeflow connect and AWS analytics.
• Experience with Lakeflow connect CDC handling and reconciliation.
• Expertise in data quality libraries and configuration-based DQ frameworks.
• Extensive Databricks lakehouse architecture design with Delta Lake and Unity Catalog.
• Experience with medallion architecture and Bronze/Silver/Gold patterns.
• Knowledge of ABAC/RBAC data security and governance.

Responsibilities

• Lead a Databricks Well‑Architected assessment across platform architecture, observability, pipelines, consumption, data quality, security, governance, and cost.
• Establish architectural patterns supporting scalable data ingestion, transformation, analytics, AI, and agent‑based solutions.
• Design and implement governance standards leveraging Databricks Unity Catalog.
• Define data architecture standards for Bronze, Silver, and Gold medallion layers.
• Architect configuration‑driven onboarding frameworks using Databricks Lakeflow, YAML/control tables, and automated CI/CD.
• Guide development of conformed dimensions, shared business keys, and cross‑domain data products.
• Define the architecture for an AI‑ready Gold layer with certified data products and semantic layers.
• Provide architectural direction and mentorship to Data & AI Engineers; lead reviews.
• Deliver a secure, observable, governed, cost‑aware, AI‑ready Databricks architecture and enable operational readiness.

Skills

Databricks Lakeflow

AWS analytics

Data quality

Delta Lake

Unity Catalog

Spark

Medallion arch

Tools

Lakeflow

Unity Catalog

Job description

Eliassen Group is seeking a Senior Solution Architect to lead Databricks, Data & AI modernization efforts remotely in the U.S. You will own the overall architecture, guide senior engineers, and drive governance, security, and cost‑aware platform design across the Databricks Lakehouse.

The role is hands‑on and spans enterprise architecture, platform design, and problem solving, coordinating with platform, data, security, and business teams to deliver scalable, AI‑ready data solutions.