Databricks Data & AI Architect — Remote Lead

Eliassen Group; Jackson (MS); Remote; USD 138,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Senior Solution Architect to lead the Databricks, Data & AI modernization effort. You will own the overall architecture, guide platform teams, and drive governance, observability, and AI enablement across a scalable data platform.

The role is hands‑on and requires moving between enterprise architecture, platform design, and technical problem solving, collaborating with security, engineering, and business stakeholders on a large modernization program.

Qualifications

• Deep understanding of Databricks Lakeflow capabilities and AWS analytics services.
• Experience addressing ingestion challenges from Lakeflow connect including CDC handling.
• Experience with data quality libraries and configuration‑based frameworks that plug DQ into ingestion pipelines.
• Extensive experience designing enterprise Databricks lakehouse architectures with Spark, Delta Lake, Lakeflow and Unity Catalog.
• Strong experience with medallion architecture and Bronze/Silver/Gold data patterns.

Responsibilities

• Lead a Databricks Well‑Architected assessment across platform architecture and governance; define target‑state architecture and standards.
• Guide engineering teams to implement standards for ingestion, analytics, and CI/CD; ensure cost and security controls.
• Define governance standards using Unity Catalog; establish access controls, data classification, tagging, and lineage.
• Define Bronze/Silver/Gold data patterns and reusable ingestion/processing templates; enable conformed dimensions and cross‑domain data products.
• Architect AI‑ready data layers and semantic contexts; outline ML/GenAI interfaces and governance.
• Provide architectural mentorship and lead reviews; deliver reusable patterns and runbooks.
• Produce architecture scorecards and remediation plans for operations readiness.

Skills

Databricks Lakeflow connect

AWS analytics

data quality libraries

configuration‑based frameworks

Lakeflow

Unity Catalog

CI/CD

Data governance

AI/GenAI concepts

Tools

Databricks

Lakeflow

Unity Catalog

Spark

Delta Lake

Job description

Eliassen Group is seeking a Senior Solution Architect to lead the Databricks, Data & AI modernization effort. You will own the overall architecture, guide platform teams, and drive governance, observability, and AI enablement across a scalable data platform.

The role is hands‑on and requires moving between enterprise architecture, platform design, and technical problem solving, collaborating with security, engineering, and business stakeholders on a large modernization program.