Senior AI & Data Engineer (Databricks) – Remote

Eliassen Group; Hagåtña (GU); Remote; USD 110,000 - 124,000; Part time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote, contract role emphasizes building robust data pipelines, data products, and semantic layers across domains.

The ideal candidate will have advanced Databricks and Python/SQL skills, experience with data governance and CI/CD, and the ability to implement scalable architectures and AI-ready data products. W2 benefits apply, with a competitive hourly rate.

Qualifications

• Advanced hands-on experience with Databricks, Spark, Delta Lake, and SQL.
• Hands-on experience with AWS analytics services (EMR, Bedrock).
• Strong Python and SQL development skills.
• Experience building scalable batch and streaming data pipelines.
• Deep understanding of Bronze/Silver/Gold medallion architectures.
• Experience with Databricks Lakeflow or equivalent orchestration tech.
• Experience implementing data quality, lineage, observability, and monitoring.
• Experience with Unity Catalog in governed environments.
• Knowledge of dimensional modeling and cross-domain data products.
• Experience with Git-based development and CI/CD.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from enterprise applications, databases, APIs, SaaS, files, and more.
• Maintain Bronze, Silver, Gold medallion architectures.
• Implement incremental processing and change data capture where applicable.
• Standardize types, codes, units, keys, and business definitions across sources.
• Implement deduplication, history tracking, schema evolution, and data lineage.
• Optimize pipelines for reliability, performance, and cost.
• Build configuration-driven onboarding frameworks and Lakeflow templates.
• Automate source registration, deployment, monitoring, lineage, and controls.
• Implement data quality, anomaly detection, monitoring, and quarantine.
• Implement job and pipeline monitoring, alerting, and audit logging.
• Support automated deployment and promotion using Databricks Asset Bundles and CI/CD.
• Develop conformed dimensions and shared-key strategies across domains.
• Build integrated Gold-layer products and reusable data contracts.
• Build AI-ready Gold data products with ownership and quality info.
• Develop semantic context, glossary, ontology, and KPIs in Unity Catalog.
• Build governed Unity Catalog functions and agent-ready tools/endpoints.
• Implement tracing, evaluation, testing, monitoring, and governance for AI workflows.
• Support development of AI agents using trusted enterprise data.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Python

Education

Databricks Data Engineer Professional or equivalent

Tools

Databricks Lakeflow

CI/CD

Git-based development

Unity Catalog

Job description

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This remote, contract role emphasizes building robust data pipelines, data products, and semantic layers across domains.

The ideal candidate will have advanced Databricks and Python/SQL skills, experience with data governance and CI/CD, and the ability to implement scalable architectures and AI-ready data products. W2 benefits apply, with a competitive hourly rate.