Senior Databricks Data & AI Solutions Architect (Remote)

Eliassen Group; Austin (TX); Remote; USD 138,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company match

Life insurance

Job summary

Eliassen Group is seeking a Senior Solution Architect to lead a Databricks, Data & AI modernization effort. This remote contract role requires hands-on architecture leadership across platform design, governance, observability, and AI/GenAI enablement, while collaborating with platform, data, security, and engineering teams.

The ideal candidate brings deep Databricks expertise, experience with Lakeflow, Unity Catalog, and data governance, and can drive scalable, secure, and cost-aware solutions

Qualifications

• Deep understanding of Databricks Lakeflow connect capabilities and AWS analytics and ingestion services.
• Extensive experience addressing ingestion challenges from unsupported sources by Lakeflow connect, including CDC handling and reconciliation techniques.
• Expertise with data quality libraries and configuration‑based frameworks that plug DQ into ingestion pipelines.
• Extensive experience designing enterprise Databricks lakehouse architectures with Spark, Delta Lake, Lakeflow, and Unity Catalog.
• Strong experience with medallion architecture and Bronze/Silver/Gold data patterns.
• Experience designing enterprise data governance, lineage, security, and access‑control frameworks including ABAC and RBAC, data classification, tagging, and least‑privilege security.
• Experience designing production‑grade data pipelines, reusable ingestion frameworks, observability, CI/CD, deployment automation, and production support.
• Experience designing semantic layers and governed enterprise data products, and architecting AI or GenAI solutions operating against governed enterprise data, including Databricks Genie and AI/BI.
• Experience with MCP and agent‑based architectures, GenAI governance, tracing, and evaluation preferred.
• Strong communication skills and ability to work across engineering, security, architecture, and business teams.

Responsibilities

• Lead a Databricks Well‑Architected assessment across platform architecture, observability, pipelines, consumption, data quality, security, governance, and cost.
• Define target‑state architecture and technical standards for the Data & AI platform.
• Identify architectural gaps, technical debt, platform risks, and remediation priorities.
• Establish architectural patterns supporting scalable data ingestion, transformation, analytics, AI, and agent‑based solutions.
• Guide engineering teams in implementing standards and remediation priorities.
• Establish standards for development, test, production promotion, CI/CD, monitoring, and operational support.
• Design and implement governance standards leveraging Databricks Unity Catalog.
• Define least‑privilege access models, ABAC, data classification, tagging, and lineage standards.

Skills

Databricks

Lakeflow

Unity Catalog

Delta Lake

GenAI governance

CI/CD

ABAC/RBAC

Tools

Databricks Lakeflow

Job description

Eliassen Group is seeking a Senior Solution Architect to lead a Databricks, Data & AI modernization effort. This remote contract role requires hands-on architecture leadership across platform design, governance, observability, and AI/GenAI enablement, while collaborating with platform, data, security, and engineering teams.

The ideal candidate brings deep Databricks expertise, experience with Lakeflow, Unity Catalog, and data governance, and can drive scalable, secure, and cost-aware solutions