Remote Senior Databricks Data & AI Architect

Eliassen Group; Augusta (ME); Remote; USD 138,000 - 145,000; Full time

Benefits offered by this job

Medical benefits (Dental, Vision)

401(k) with company match

Life insurance

Referral program

Job summary

Eliassen Group is seeking a Senior Solution Architect to provide technical leadership for a large-scale Data & AI modernization initiative, focusing on Databricks platform modernization, data engineering, governance, and AI/agent enablement.

This hands-on role spans enterprise architecture, platform design, and problem solving, with collaboration across platform, data, security, business, and engineering teams.

Qualifications

• Deep understanding of Databricks Lakeflow connect capabilities and AWS analytics services.
• Experience addressing ingestion challenges with Lakeflow connect including CDC handling.
• Expertise with data quality libraries and config-based frameworks that plug DQ into ingestion pipelines.
• Extensive experience designing enterprise Databricks lakehouse architectures with Spark, Delta Lake, Lakeflow, and Unity Catalog.
• Strong experience with medallion architecture and Bronze/Silver/Gold data patterns.

Responsibilities

• Lead a Databricks Well‑Architected assessment across platform architecture, observability, pipelines, consumption, data quality, security, governance, and cost.
• Establish architectural patterns supporting scalable data ingestion, transformation, analytics, AI, and agent‑based solutions.
• Design and implement governance standards leveraging Unity Catalog. Define least‑privilege access models, ABAC/RBAC, data tagging and lineage.
• Define architecture for Bronze/Silver/Gold medallion layers and reusable data patterns for ingestion, quality, and deployment.
• Provide architectural direction and mentorship to Data & AI Engineers and lead design reviews.

Skills

Databricks Lakeflow

Unity Catalog

Delta Lake

Data governance

CI/CD

AWS analytics

Observability

Tools

Databricks Lakeflow

Unity Catalog

Delta Lake

CI/CD tools

Job description

Eliassen Group is seeking a Senior Solution Architect to provide technical leadership for a large-scale Data & AI modernization initiative, focusing on Databricks platform modernization, data engineering, governance, and AI/agent enablement.

This hands-on role spans enterprise architecture, platform design, and problem solving, with collaboration across platform, data, security, business, and engineering teams.