Staff AI & Data Engineer (Databricks) - Remote

Eliassen Group; Madison (WI); Remote; USD 110,000 - 124,000; Full time

Job summary

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks in a remote contract role. The position emphasizes creating trusted data products, semantic layers, and governance across pipelines while enabling cross-domain analytics and AI agent readiness.

The ideal candidate has deep Databricks experience, strong Python/SQL skills, and familiarity with CI/CD, data quality, and Unity Catalog.

Qualifications

• Advanced hands-on experience with Databricks, Spark, Delta Lake, and SQL.
• Experience building scalable batch and streaming data pipelines.
• Strong Python and SQL development skills.
• Experience with Unity Catalog and governed data environments.
• Knowledge of CI/CD, automated testing, and production deployment.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from enterprise applications, databases, APIs, SaaS platforms, files, and other source systems.
• Build Bronze/Silver/Gold medallion architectures and implement CDC.
• Standardize types, codes, units, keys, and business definitions across sources.
• Implement data quality, lineage, observability, and monitoring.
• Develop AI-ready Gold data products with ownership and quality information.
• Support automated deployment and promotion using Databricks Asset Bundles and CI/CD.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Python

AWS

CI/CD

Data quality

Data governance

Unity Catalog

GenAI

MCP

Git workflows

Tools

Databricks Lakeflow

Job description

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks in a remote contract role. The position emphasizes creating trusted data products, semantic layers, and governance across pipelines while enabling cross-domain analytics and AI agent readiness.

The ideal candidate has deep Databricks experience, strong Python/SQL skills, and familiarity with CI/CD, data quality, and Unity Catalog.