Staff AI & Data Engineer on Databricks - Remote

Eliassen Group; City of Albany (NY); Remote; USD 110,000 - 124,000; Part time

Job summary

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This role focuses on strengthening the Databricks platform, onboarding new data sources, and creating trusted Gold-layer data products across domains.

The position requires hands-on Databricks, Spark, Python, and SQL expertise, with emphasis on data quality, governance, and AI-ready architectures in a remote, contract setting.

Qualifications

• Advanced hands-on Databricks and Spark experience.
• Strong SQL and Python development skills.
• Experience with data quality, governance, and AI governance.

Responsibilities

• Design and build production-grade data pipelines on Databricks.
• Ingest data from various sources and maintain layered architectures.
• Implement data quality, lineage, and monitoring frameworks.
• Develop AI/GenAI solutions and semantic data models.
• Collaborate across domains to enable cross-domain analytics.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Python

GenAI

AWS EMR

CI/CD

Tools

Databricks Lakeflow

CI/CD tooling

Job description

Eliassen Group is seeking a Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This role focuses on strengthening the Databricks platform, onboarding new data sources, and creating trusted Gold-layer data products across domains.

The position requires hands-on Databricks, Spark, Python, and SQL expertise, with emphasis on data quality, governance, and AI-ready architectures in a remote, contract setting.