Staff AI & Data Engineer, Databricks — Remote

Eliassen Group; Helena (MT); Remote; USD 110,000 - 124,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

401k with company match

Life insurance

Job summary

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote, contract role focuses on strengthening the Databricks platform, onboarding new data sources, and creating trusted Gold-layer data products.

The candidate will develop semantic layers, governance, and AI agent capabilities across domains. The ideal candidate has advanced Databricks, Spark, Delta Lake, and Python/SQL skills, plus experience with CI/CD, data

Qualifications

• Advanced hands-on experience with Databricks, Apache Spark, Delta Lake, and SQL.
• Hands-on experience with AWS data analytics services (EMR, Bedrock).
• Strong Python and SQL development skills.
• Experience building scalable batch and/or streaming data pipelines.
• Deep understanding of Bronze/Silver/Gold medallion architectures.
• Experience with Unity Catalog and governed enterprise data environments.
• Experience with Git-based development, CI/CD, automated testing, and production deployment.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from enterprise applications, databases, APIs, and files.
• Maintain Bronze, Silver, and Gold medallion architectures.
• Implement incremental processing and change data capture patterns.
• Standardize types, codes, units, keys, and business definitions across sources.
• Implement data quality, lineage, and governance processes.
• Develop AI-ready data products and semantic contexts within Unity Catalog.
• Support automated deployment and CI/CD for Databricks assets.
• Build reusable ingestion frameworks and Lakeflow templates.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Python

AWS (EMR/Bedrock)

Data pipelines

CI/CD

Git

AI/GenAI

Data governance

Unity Catalog

Lakeflow

Job description

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote, contract role focuses on strengthening the Databricks platform, onboarding new data sources, and creating trusted Gold-layer data products.

The candidate will develop semantic layers, governance, and AI agent capabilities across domains. The ideal candidate has advanced Databricks, Spark, Delta Lake, and Python/SQL skills, plus experience with CI/CD, data