Senior AI & Data Engineer — Databricks (Remote, W2)

Eliassen Group; Juneau (AK); Remote; USD 110,000 - 124,000; Full time

Job summary

Eliassen Group is seeking a Staff AI & Data Engineer with Databricks expertise to design and build enterprise-grade data and AI solutions. You will strengthen the Databricks platform, onboard data sources, and create reusable ingestion frameworks, semantic layers, and AI-ready gold data products.

The role emphasizes cross-domain analytics, data quality, governance, and scalable architectures. Strong Python/SQL, Spark, and Delta Lake skills are essential, with a focus on NL analytics and AI agent

Qualifications

• Advanced hands-on experience with Databricks, Spark, Delta Lake, and SQL.
• Hands-on AWS analytics/AI services including EMR and Bedrock.
• Strong Python and SQL development skills.
• Experience building scalable data pipelines (batch/streaming).
• Expertise in Bronze/Silver/Gold medallion architectures.
• Experience with Lakeflow or orchestration tech.
• Enterprise data quality, lineage, observability, monitoring.
• Unity Catalog and governed data environments.
• Dimensional modeling, data products, semantic models, cross-domain integration.
• Git-based development, CI/CD, automated testing, production deployment.
• Troubleshooting complex distributed data/pipelines.
• Experience with AI/GenAI solutions on enterprise data.
• Semantic layers and natural-language-to-data architectures.
• Databricks Genie or similar NL analytics tech.
• APIs/services for AI agents; MCP governance awareness.
• Production AI with security and governance controls.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from enterprise apps, databases, APIs, files, and SaaS.
• Implement Bronze/Silver/Gold architectures with CDC patterns.
• Standardize codes, units, keys, and business definitions.
• Ensure data quality, lineage, monitoring, and governance.
• Build Lakeflow templates and configuration-driven onboarding.
• Automate deployment, monitoring, lineage, and controls.
• Create conformed dimensions and shared-key strategies.
• Develop AI-ready Gold data products with quality metadata.
• Develop semantic context, ontology, and KPIs in Unity Catalog.
• Build governance-enabled functions and agent-ready tools.
• Support AI/agent workflows with tracing and testing.
• Collaborate across domains to deliver end-to-end data solutions.

Skills

Databricks

Apache Spark

Delta Lake

SQL

AWS EMR

Bedrock

Python

Data pipelines

Bronze/Silver/Gold

Lakeflow

CI/CD

Unity Catalog

AI/GenAI

MCP governance

Data governance

Tools

Databricks Lakeflow

Git

CI/CD tooling

Unity Catalog

Job description

Eliassen Group is seeking a Staff AI & Data Engineer with Databricks expertise to design and build enterprise-grade data and AI solutions. You will strengthen the Databricks platform, onboard data sources, and create reusable ingestion frameworks, semantic layers, and AI-ready gold data products.

The role emphasizes cross-domain analytics, data quality, governance, and scalable architectures. Strong Python/SQL, Spark, and Delta Lake skills are essential, with a focus on NL analytics and AI agent