Strategic Data Architect — Databricks & Snowflake Expert

State Street; Town of Clifton (NY); On-site; USD 125,000 - 226,000; Full time

Benefits offered by this job

401K match

Comprehensive insurance

Paid time off

Employee assistance program

Job summary

State Street is seeking an experienced Senior Databricks / Snowflake Data Architect to design and evolve our cloud-native data platform supporting multi-asset Transaction Cost Analysis (TCA), analytics, and reporting.

You will lead architecture decisions, prototype new technologies, and mentor teams while partnering with quantitative researchers and engineering. The role emphasizes DataOps, CI/CD, and security, with a focus on scalable lakehouse solutions using Databricks, Snowflake, and AWS.

Qualifications

• Experience designing and implementing enterprise-scale data platforms.
• Hands-on Databricks and Snowflake experience.
• Strong knowledge of Apache Spark, Python, and SQL.
• Proven ability to rapidly evaluate emerging technologies and architectural patterns.
• Experience with cloud platforms (AWS) and data governance.

Responsibilities

• Design and develop the architecture for multi-asset TCA and analytics platform.
• Lead technology evaluations, proofs-of-concept, and rapid prototyping.
• Architect and implement scalable data lakehouse solutions using Databricks, Snowflake, and cloud-native services.
• Design high-performance data models, ingestion frameworks, and transformation pipelines for real-time and batch processing.
• Establish best practices for data governance, lineage, security, metadata management, and observability.
• Mentor engineering teams and define technology roadmaps for data warehousing and lakehouse workloads.

Skills

Databricks

Snowflake

Apache Spark

Python

SQL

ELT/ETL

CI/CD

Data governance

AWS

Cloud platforms

Tools

Delta Lake

Unity Catalog

Spark Structured Streaming

Snowpark

Kafka

EventBridge

Job description

State Street is seeking an experienced Senior Databricks / Snowflake Data Architect to design and evolve our cloud-native data platform supporting multi-asset Transaction Cost Analysis (TCA), analytics, and reporting.

You will lead architecture decisions, prototype new technologies, and mentor teams while partnering with quantitative researchers and engineering. The role emphasizes DataOps, CI/CD, and security, with a focus on scalable lakehouse solutions using Databricks, Snowflake, and AWS.