Senior Databricks & AI Solution Architect (Remote)

Eliassen Group; Lincoln (NE); Remote; USD 138,000 - 145,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with company match

Life insurance

Job summary

Eliassen Group is seeking a Senior Solution Architect to lead a Databricks, Data & AI modernization effort. You will own the architecture across platform design, governance, and AI enablement while mentoring senior staff engineers.

This remote, contract role requires hands-on leadership and cross‑functional collaboration with security, business, and engineering teams. The role emphasizes scalable, governed data platforms using Unity Catalog, Lakeflow, and GenAI-enabled solutions, with a focus on

Qualifications

• Deep understanding of Databricks Lakeflow connect capabilities and AWS analytics and ingestion services.
• Extensive experience addressing ingestion challenges from Lakeflow connect, including CDC handling.
• Expertise with data quality libraries and configuration-based frameworks that plug DQ into ingestion pipelines.
• Extensive experience designing enterprise Databricks lakehouse architectures with Spark, Delta Lake, Lakeflow, and Unity Catalog.
• Strong experience with medallion architecture and Bronze/Silver/Gold data patterns.
• Experience designing enterprise data governance, lineage, security, and access-control frameworks including ABAC and RBAC.
• Experience designing production-grade data pipelines, reusable ingestion frameworks, observability, CI/CD, deployment automation, and production support.
• Experience designing semantic layers and governed enterprise data products, and architecting AI or GenAI solutions.

Responsibilities

• Lead a Databricks Well‑Architected assessment across platform architecture, observability, pipelines, and data quality.
• Define target‑state architecture and technical standards for the Data & AI platform; identify gaps and risks.
• Guide engineering teams in implementing standards and remediation priorities; set development and CI/CD patterns.
• Define governance standards leveraging Unity Catalog and data classification, tagging, and lineage.
• Define data architecture standards for Bronze/Silver/Gold; onboard with Lakeflow, YAML/control tables and CI/CD.
• Design AI-ready data products and semantic layers; craft governance and tracing interfaces.
• Provide architectural direction and mentorship to Data & AI Engineers; participate in reviews.
• Deliver a scalable, secure, governed Databricks architecture with reusable patterns and runbooks.

Skills

Databricks Lakeflow

AWS analytics

Data governance

Unity Catalog

CI/CD

Observability

GenAI governance

Mentorship

Databricks architecture

Data lakehouse

Tools

Databricks Genie

Databricks Lakeflow

Job description

Eliassen Group is seeking a Senior Solution Architect to lead a Databricks, Data & AI modernization effort. You will own the architecture across platform design, governance, and AI enablement while mentoring senior staff engineers.

This remote, contract role requires hands-on leadership and cross‑functional collaboration with security, business, and engineering teams. The role emphasizes scalable, governed data platforms using Unity Catalog, Lakeflow, and GenAI-enabled solutions, with a focus on