Senior AI & Data Engineer, Databricks (Remote)

Eliassen Group

Bismarck (ND)

Remote

USD 110,000 - 124,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical benefits
Dental benefits
Vision benefits
401(k) with company match
Life insurance

Job summary

Eliassen Group is hiring a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. You will strengthen the Databricks platform, onboard new data sources, and develop reusable ingestion and transformation frameworks to enable cross-domain analytics.

The role requires hands-on experience with Databricks, Spark, Delta Lake, Python, and SQL, and involves building Gold-level data products, semantic layers, and AI-ready capabilities across pipelines,

Qualifications

  • Advanced hands-on experience with Databricks, Spark, Delta Lake, and SQL.
  • Hands-on experience with AWS data/AI services including EMR and Bedrock.
  • Strong Python and SQL development skills.
  • Experience building scalable batch and/or streaming data pipelines.
  • Deep understanding of Bronze/Silver/Gold medallion architectures.
  • Experience with Databricks Lakeflow or comparable orchestration tools.
  • Experience implementing data quality, lineage, observability, and monitoring.
  • Experience with Unity Catalog and governed data environments.
  • Knowledge of dimensional modeling and data products.
  • Experience with Git-based development, CI/CD, automated testing, and production deployment.

Responsibilities

  • Design and build production-grade data pipelines on Databricks.
  • Ingest data from enterprise apps, databases, APIs, SaaS platforms, files, and other sources.
  • Build Bronze/Silver/Gold medallion architectures.
  • Implement incremental processing and change data capture as needed.
  • Standardize types, codes, units, keys, and business definitions across sources.
  • Implement deduplication, historical tracking, schema evolution, and data lineage.
  • Optimize pipelines for reliability, performance, and cost.
  • Develop Lakeflow-backed onboarding frameworks and templates.
  • Automate source registration, deployment, monitoring, and governance.
  • Implement data quality, anomaly detection, monitoring, and quarantine processes.
  • Set up monitoring, alerting, logging, and dashboards for pipelines and jobs.
  • Support automated deployment and promotion using Databricks Asset Bundles and CI/CD.
  • Create conformed dimensions and shared-key strategies across domains.
  • Build integrated Gold-layer data products and reusable data contracts.
  • Develop AI-ready data products with ownership and quality metadata.
  • Develop semantic context, business glossary, and ontology in Unity Catalog.
  • Create governed Unity Catalog functions and agent-ready tools.
  • Implement tracing, evaluation, testing, monitoring, and governance for AI/agent workflows.
  • Support AI agents using trusted enterprise data.

Skills

Databricks
Apache Spark
Delta Lake
Python
SQL

Tools

Lakeflow
CI/CD
Git-based development
AWS (EMR,Bedrock)

Job description

Eliassen Group is hiring a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. You will strengthen the Databricks platform, onboard new data sources, and develop reusable ingestion and transformation frameworks to enable cross-domain analytics.

The role requires hands-on experience with Databricks, Spark, Delta Lake, Python, and SQL, and involves building Gold-level data products, semantic layers, and AI-ready capabilities across pipelines,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI & Data Engineer, Databricks — Remote
Staff AI & Data Engineer, Databricks — Remote

Eliassen Group • United States

Remote
USD 110,000 - 124,000
Senior AI & Data Engineer, Databricks, Remote
Senior AI & Data Engineer, Databricks, Remote

Eliassen Group • Richmond (VA)

Remote
USD 110,000 - 124,000
Medical insurance
Dental insurance
Vision insurance
+2
Senior AI & Data Engineer — Databricks, Remote
Senior AI & Data Engineer — Databricks, Remote

Eliassen Group • Montgomery (AL)

Remote
USD 110,000 - 124,000
Senior AI & Data Engineer (Databricks) — Remote
Senior AI & Data Engineer (Databricks) — Remote

Eliassen Group • Providence (RI)

Remote
USD 110,000 - 124,000
Medical Insurance
Dental Insurance
Vision Insurance
+2
Senior AI & Data Engineer – Databricks, Remote
Senior AI & Data Engineer – Databricks, Remote

Eliassen Group • Nashville (TN)

Remote
USD 110,000 - 124,000
Medical benefits
Dental benefits
Vision benefits
+2
Staff AI & Data Engineer - Databricks (Remote, W2)
Staff AI & Data Engineer - Databricks (Remote, W2)

Eliassen Group • Harrisburg

Remote
USD 110,000 - 124,000
Medical, dental, and vision benefits
401k with company matching
Life insurance
Remote Staff AI & Data Engineer (Databricks)
Remote Staff AI & Data Engineer (Databricks)

Eliassen Group • Boston (MA)

Remote
USD 110,000 - 124,000
Medical
Dental
Vision
+2
Senior AI & Data Engineer - Databricks, Remote
Senior AI & Data Engineer - Databricks, Remote

Eliassen Group • San Juan (PR)

Remote
USD 110,000 - 124,000
Medical insurance
Dental insurance
Vision insurance
+2
Staff AI & Data Engineer – Databricks (Remote)
Staff AI & Data Engineer – Databricks (Remote)

Eliassen Group • Columbus (OH)

Remote
USD 110,000 - 124,000
Medical, Dental, Vision benefits
401k with company match
Life insurance
Senior AI & Data Engineer — Databricks & GenAI (Remote)
Senior AI & Data Engineer — Databricks & GenAI (Remote)

Eliassen Group • Pierre (SD)

Remote
USD 110,000 - 124,000
Medical benefits
401k with company matching
Life insurance