Lead Data Architect - Databricks & Lakehouse

Socket.dev; California (MO); On-site; USD 180,000 - 240,000; Full time

Job summary

Socket.dev is seeking a Lead Solution Architect – Data Engineering to steer enterprise Databricks engagements from design to delivery. You will own end-to-end architectures, mentor engineers, and drive large migrations across cloud platforms.

You will lead presales activities, engage with CIOs/CTOs, and craft reusable accelerators. Strong Python/SQL/Scala, Spark expertise, and deep lakehouse governance are essential.

Qualifications

• 12+ years in data engineering/architecture.
• 3+ years on Databricks at enterprise scale.

Responsibilities

• Own end-to-end architecture and design decisions on Databricks engagements, ensuring scalable, secure, and lakehouse-aligned solutions.
• Lead delivery of production-grade data platforms for ingestion, transformation, orchestration, governance, and downstream BI/ML enablement.
• Lead large-scale migrations and cloud transformation projects to Databricks on Azure/AWS/GCP, including assessment and cutover.
• Stay hands-on with performance tuning, debugging, code and design reviews, and setting engineering standards.
• Own and defend enterprise designs in front of architecture boards and executives; drive presales end-to-end.
• Translate technical trade-offs into decisions that executives can act on.

Skills

Databricks

Spark

Python

SQL

Scala

Unity Catalog

Delta Lake

Airflow

DLT/Workflows

MLflow

LLM APIs

CI/CD for data platforms

Tools

Azure

AWS

GCP

Job description

Socket.dev is seeking a Lead Solution Architect – Data Engineering to steer enterprise Databricks engagements from design to delivery. You will own end-to-end architectures, mentor engineers, and drive large migrations across cloud platforms.

You will lead presales activities, engage with CIOs/CTOs, and craft reusable accelerators. Strong Python/SQL/Scala, Spark expertise, and deep lakehouse governance are essential.