Cloud Data Architect — Databricks & Snowflake Lakehouse Lead

STATE STREET CORPORATION; Greater London; On-site; GBP 120,000 - 160,000; Full time

Job summary

State Street Corporation in London is seeking an experienced Senior Databricks / Snowflake Data Architect to lead the design and evolution of a cloud-native data platform supporting multi-asset TCA, analytics and reporting.

You will prototype, evaluate emerging tech, and drive scalable production implementations while partnering with researchers and product teams.

This role requires hands-on engineering mindset, strong data architecture, and leadership across platform initiatives.

Qualifications

• Experience designing enterprise-scale data platforms.
• Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture
• Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities

Responsibilities

• Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform
• Lead technology evaluations, proof-of-concepts, and rapid prototyping across modern data platforms and cloud-native technologies
• Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services
• Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads
• Establish best practices for data governance, lineage, security, metadata management, and platform observability
• Build and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasets
• Work closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutions
• Define architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloads
• Drive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practices
• Develop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIR
• Mentor engineering teams and provide technical leadership across strategic platform initiatives
• Take ownership of architecture decisions from concept through production delivery

Skills

Databricks

Snowflake

Apache Spark

Python

SQL

Data architecture

AWS

CI/CD

DevOps mindset

Stakeholder management

Tools

Delta Lake

Snowpark

Spark Streaming

Kafka

Job description

State Street Corporation in London is seeking an experienced Senior Databricks / Snowflake Data Architect to lead the design and evolution of a cloud-native data platform supporting multi-asset TCA, analytics and reporting.

You will prototype, evaluate emerging tech, and drive scalable production implementations while partnering with researchers and product teams.

This role requires hands-on engineering mindset, strong data architecture, and leadership across platform initiatives.