Senior AI & Data Engineer (Databricks) - Remote

Eliassen Group; Denver (CO); Remote; USD 110,000 - 124,000; Full time

Job summary

Eliassen Group seeks a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote contract role focuses on strengthening the Databricks platform, onboarding data sources, and creating Gold-layer data products and AI-ready capabilities.

The ideal candidate has advanced Databricks, Spark, Delta Lake, Python, and SQL experience, plus API and CI/CD know-how to enable scalable, governed data delivery. W2 benefits apply for eligible consultants.

Qualifications

• Advanced hands-on experience with Databricks, Spark, Delta Lake and SQL.
• AWS data analytics services including EMR and Bedrock.
• Strong Python and SQL development skills.
• Experience building scalable batch and streaming data pipelines.
• Knowledge of Bronze/Silver/Gold medallion architectures.
• Experience with Lakeflow or similar orchestration tools.
• Implement data quality, lineage, observability and monitoring.
• Experience with Unity Catalog and governed data environments.
• Understanding of dimensional modeling, data products and cross-domain integration.
• Git-based development, CI/CD, automated testing and prod deployment.
• Experience building AI/GenAI solutions against enterprise data.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from enterprise apps, databases, APIs, and files.
• Maintain Bronze, Silver and Gold medallion architectures.
• Implement incremental processing and change data capture.
• Standardize codes, units and business definitions across sources.
• Ensure data quality, lineage, monitoring, and governance.
• Develop AI-ready data products and semantic context.
• Collaborate on CI/CD, deployment and monitoring dashboards.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Python

Data pipelines

Lakeflow

Data quality

Data governance

Unity Catalog

CI/CD

AI/GenAI

API & tools for AI

MLflow

Tools

AWS EMR

Bedrock

Git

Job description

Eliassen Group seeks a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote contract role focuses on strengthening the Databricks platform, onboarding data sources, and creating Gold-layer data products and AI-ready capabilities.

The ideal candidate has advanced Databricks, Spark, Delta Lake, Python, and SQL experience, plus API and CI/CD know-how to enable scalable, governed data delivery. W2 benefits apply for eligible consultants.