Databricks Data Platform Architect for Enterprise Solutions

EXL; San Francisco (CA); Hybride; USD 180 000 - 240 000; Plein temps

Résumé du poste

EXL is seeking a Solution Architect for Data Platform on Databricks in San Francisco. The role owns end-to-end design across ingestion, medallion layering, serving, and ML, aligning with risk, fraud, finance, marketing, and collections needs.

You will drive architectural decisions, roadmap creation, and cross-team collaboration with engineering and vendors. The candidate will guide migration from legacy Hadoop/Hive/EMR to a scalable data platform, shaping security, governance, and cost models

Qualifications

• 12+ years in data engineering or architecture with 5+ years on Databricks lakehouse.
• Strong Spark, Delta Lake, SQL and data modelling experience.
• Experience with AWS networking, IAM, encryption and multi-account design.
• Secure design for PII/NPI with lineage and audit controls.
• Migration planning from Hadoop/Hive/EMR to modern platforms.
• Ability to decide batch vs. streaming and hybrid architectures.

Responsabilités

• Define enterprise data architecture on Databricks including ingestion, medallion layering, serving and ML.
• Run discovery sessions and translate requirements into solution designs and roadmaps.
• Design identities, segmentation and compliant data sharing for marketing platforms.
• Plan near-real-time delinquency data flows and vendor file exchanges.
• Make cross-cutting decisions on tech stack, DR, and cost models.
• Lead security architecture with Unity Catalog, encryption and lineage.
• Plan migration from legacy systems to the new platform.
• Build business case and FinOps guardrails for platform investments.
• Chair architecture review boards and maintain standards and references.
• Manage Databricks and cloud provider vendor relationships and evaluations.

Connaissances

Databricks expertise

12+ years experience

Stakeholder management

Vendor management

Communication

Cost modeling

Architectural decision making

Outils

Databricks

AWS

Kafka

Structured Streaming

SQL

Spark

Unity Catalog

FinOps

Description du poste

EXL is seeking a Solution Architect for Data Platform on Databricks in San Francisco. The role owns end-to-end design across ingestion, medallion layering, serving, and ML, aligning with risk, fraud, finance, marketing, and collections needs.

You will drive architectural decisions, roadmap creation, and cross-team collaboration with engineering and vendors. The candidate will guide migration from legacy Hadoop/Hive/EMR to a scalable data platform, shaping security, governance, and cost models