Principal Data Platform Architect

Redfin; Seattle (WA); On-site; USD 234,000 - 286,000; Full time

Job summary

Redfin is seeking a Principal Software Engineer to serve as the chief architect for our enterprise data platform. You will design a unified Lakehouse on Snowflake and AWS, enabling self-serve access for data scientists and AI agents while ensuring security and scalability.

Lead cross-team architecture, mentor staff, and define data governance, RBAC, and ELT standards using dbt, PySpark, and Terraform. Join a team of 60+ engineers shaping Redfin's data-driven future.

Qualifications

• 12+ years software/data engineering experience.
• 5+ years operating at Staff/Principal/Lead Architect level.
• AWS S3/IAM/EKS and Snowflake expertise.
• Experience with Apache Iceberg open table formats.
• Data ingestion/ELT with modern pipelines (Fivetran, Airbyte) and streaming (Kafka, Kinesis).
• Data modeling: Star Schema and dimensional modeling.
• Proficient in SQL, Python, and distributed compute (Spark/Ray).
• RBAC and cross-domain security in regulated environments.
• CI/CD with Terraform and notable tooling (Azure DevOps, GitHub Actions).

Responsibilities

• Design and scale a unified Data Lakehouse on Snowflake/AWS.
• Architect resilient data ingestion frameworks for batch and streaming.
• Define a multi-tenant data mesh with RBAC policies.
• Lead deployment of a universal semantic layer for consistent metrics across tools and AI agents.
• Standardize ELT patterns using dbt, PySpark and Snowpark.
• Drive Infrastructure-as-Code (IaC) with Terraform.
• Mentor Staff and Senior ICs; lead architecture reviews and establish best practices.
• Collaborate with Principal Architects to ensure interoperable enterprise architecture.

Skills

Software engineering

Staff/Lead Architect

AWS

Snowflake

Apache Iceberg

ETL/ELT

Kafka / Kinesis

RBAC security

Terraform

Tools

dbt

PySpark

Snowpark

Job description

Redfin is seeking a Principal Software Engineer to serve as the chief architect for our enterprise data platform. You will design a unified Lakehouse on Snowflake and AWS, enabling self-serve access for data scientists and AI agents while ensuring security and scalability.

Lead cross-team architecture, mentor staff, and define data governance, RBAC, and ELT standards using dbt, PySpark, and Terraform. Join a team of 60+ engineers shaping Redfin's data-driven future.