Senior Databricks Architect – Data & ML Platforms

Robotics Technologies LLC; San Francisco (CA); On-site; USD 82,000 - 117,000; Full time

Job summary

Robotics Technologies LLC in San Francisco, CA seeks a Databricks Solution Architect for an 8-month engagement to design and govern data platforms. You will define target-state architecture, orchestrate stakeholder discovery, and plan migrations from legacy Hadoop/Hive while shaping cost and capacity models in Databricks.

Responsibilities include leading architecture reviews, vendor evaluations, and PoCs, with emphasis on security, governance, and scalable data solutions for marketing,

Qualifications

• 7+ years in data engineering or architecture with cloud data platforms.
• 5+ years hands-on need Databricks experience and architecture work.
• Strong knowledge of Spark, Delta Lake, SQL and medallion models.
• Experience in AWS networking, IAM, encryption and multi-account design.
• Experience with data governance, Unity Catalog and PII protection.
• Migrating legacy Hadoop/Hive and data warehouse workloads.

Responsibilities

• Define target-state architecture for data ingestion, medallion layers and ML workloads on Databricks.
• Lead stakeholder discovery and translate business needs into designs and roadmaps.
• Design marketing data solutions for identity resolution and campaign analytics.
• Architect collections data for delinquency monitoring and data sharing.
• Define batch/streaming patterns and multi-account AWS architecture.
• Establish security, governance and data lineage with Unity Catalog.
• Plan migration from Hadoop/Hive and EMR-based platforms.
• Develop Databricks cost models and FinOps controls.
• Lead architecture reviews, vendor evaluations and PoCs.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Medallion architecture

Dimensional data modeling

AWS

Unity Catalog

PII/NPI protection

Hadoop/Hive migration

Kafka

Structured Streaming

FinOps / cost optimization

Architecture documentation

Job description

Robotics Technologies LLC in San Francisco, CA seeks a Databricks Solution Architect for an 8-month engagement to design and govern data platforms. You will define target-state architecture, orchestrate stakeholder discovery, and plan migrations from legacy Hadoop/Hive while shaping cost and capacity models in Databricks.

Responsibilities include leading architecture reviews, vendor evaluations, and PoCs, with emphasis on security, governance, and scalable data solutions for marketing,