Senior Databricks Data Engineer: Genie & Lakehouse Lead

Vation Ventures; Denver (CO); On-site; USD 125,000 - 175,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

DTO policy

Job summary

Vation Ventures is an AI strategy and delivery consultancy helping enterprise clients build production data and AI systems. Teams are small, engineers work directly with clients, and Databricks is the platform underneath most of the work.

This role owns Databricks delivery: the pipelines, the semantic layer that decides Genie answers, and the agents on top. We balance depth in Databricks with competence in Snowflake and Fabric to serve diverse client platforms.

Qualifications

• 5+ years in data engineering with Databricks in production.
• Strong SQL and Python; ability to read a query plan and explain slow jobs.
• Semantic and dimensional modeling depth, platform-agnostic.
• Hands-on Genie work or substantial experience with Genie spaces since June 2026.
• Working competence in Snowflake; informed about Fabric and Power BI semantics.
• Ability to engage with client teams and discuss architecture openly.

Responsibilities

• Build and govern the semantic foundation Genie depends on, including Unity Catalog metrics and agent metadata.
• Deploy Genie One and Genie Agents against client data estates and establish evaluation practice for conversational analytics.
• Develop ingestion and transformation with Lakeflow, including Spark Declarative Pipelines and Delta Live Tables.
• Model the lakehouse and own Unity Catalog governance to pass client security reviews.
• Engineer for cost and performance with clear workload accounting.
• Develop agents with Mosaic AI and deliver interfaces on Databricks Apps.
• Contribute to release pipeline decisions for Genie Ontology and related tech, balancing preview features with client readiness.
• Provide guidance on Snowflake usage and Fabric integration, offering honest platform comparisons.

Skills

Data engineering

SQL

Python

Semantic modeling

Genie AI platforms

Client-facing

Tools

Databricks

Snowflake

Fabric

Unity Catalog

Job description

Vation Ventures is an AI strategy and delivery consultancy helping enterprise clients build production data and AI systems. Teams are small, engineers work directly with clients, and Databricks is the platform underneath most of the work.

This role owns Databricks delivery: the pipelines, the semantic layer that decides Genie answers, and the agents on top. We balance depth in Databricks with competence in Snowflake and Fabric to serve diverse client platforms.