Lead Databricks Architect — Data & AI Platform

Robotics Technologies; Princeton (NJ); On-site; USD 96,000 - 129,000; Full time

Job summary

Robotics Technologies LLC in Princeton, NJ seeks a hands-on Lead Data and AI Architect to design and build governed, conversational self‑service data solutions on Databricks. You’ll lead architecture from source data to the answers business users receive, combining a federated data platform with a governed semantic layer and conversational AI.

You’ll guide a small engineering team, establish data definitions across units, publish to a central hub without copying data, and implement ABAC

Qualifications

• 10–12 years in data engineering/architecture, incl. 3+ years as hands-on architect on a delivery team.
• 3+ years production Databricks with Unity Catalog, Delta Lake, Lakehouse Federation and Delta Sharing.
• Experience delivering Genie/LLM agent solutions with evaluation of answer accuracy.
• Strong SQL and Python; PySpark; Git and CI/CD for data assets.

Responsibilities

• Own end-to-end Databricks conversational self-service architecture.
• Design federated hub with shared definitions; data units retain context.
• Define semantic layer: ontology, keys, metrics, rules, lineage, and sources.
• Publish local definitions to hub, map to common model without data copying.
• Establish governance: ownership, versioning, approvals, impact analysis.
• Build Unity Catalog metric views and ABAC policies with row filters.
• Configure Genie spaces/agents and Agent Bricks for routing questions.
• Use Lakehouse Federation/Delta Sharing for in-place data hosting.
• Manage metric views and agent configs in Git with CI/CD.
• Measure answer accuracy with MLflow tracing and evaluation.
• Explain architecture decisions and run workshops for stakeholders.

Skills

SQL

Python

PySpark

Git

CI/CD

Data modeling

Communication

Tools

Databricks

Unity Catalog

Delta Lake

Delta Sharing

Lakehouse Federation

dbt metrics

Job description

Robotics Technologies LLC in Princeton, NJ seeks a hands-on Lead Data and AI Architect to design and build governed, conversational self‑service data solutions on Databricks. You’ll lead architecture from source data to the answers business users receive, combining a federated data platform with a governed semantic layer and conversational AI.

You’ll guide a small engineering team, establish data definitions across units, publish to a central hub without copying data, and implement ABAC