Principal Software Developer - Data

quickenloans; Seattle (WA); On-site; USD 180,000 - 260,000; Full time

Job summary

Redfin, a Rocket Companies portfolio entity, seeks a Principal Software Engineer to serve as the chief architect for our enterprise data platform. You will design and scale a unified Data Lakehouse on Snowflake with Iceberg, AWS, and RBAC, providing self-serve access for data scientists and AI agents.

You will mentor senior ICs, shape data governance, and drive cross-domain collaboration across a 60+ engineer organization, ensuring secure, scalable architecture across boundaries.

Qualifications

• Experience: 12+ years of software/data engineering, with at least 5+ years operating at a Staff, Principal, or Lead Architect level.
• Cloud & Lakehouse: AWS (S3, IAM, EKS) and Snowflake; Iceberg adoption experience.
• Data Ingestion & ELT: pipelines with Fivetran, Airbyte; streaming with Kafka, Kinesis, Snowpipe.
• Data Modeling: Star schema and dimensional modeling for analytics.
• Processing Frameworks: Proficient in SQL, Python, Spark/Ray, or Snowflake compute.
• Data Governance & Security: multi-tenant architectures with RBAC and cross-domain policies.
• CI/CD & IaC: CI/CD pipelines and Terraform for infra provisioning.

Responsibilities

• Design and scale a unified Data Lakehouse using Snowflake with Iceberg architecture on AWS.
• Architect resilient ingestion pipelines from databases, APIs, and logs into Bronze storage.
• Build a multi-tenant data mesh with domain admin and RBAC for secure cross-domain sharing.
• Lead semantic layer deployment to ensure metric consistency across BI tools and AI agents.
• Define Medallion data flow standards (Bronze/Silver/Gold) and modern ELT patterns with dbt, PySpark, Snowpark.
• Drive IaC culture using Terraform for platform provisioning, networking, and security.
• Mentor 60+ engineers, lead architecture reviews, and establish engineering best practices.
• Act as liaison to Principal Architects to ensure interoperable enterprise architecture.

Skills

Architectural leadership

Staff/Principal experience

Cloud data architecture

Data governance

Security policy design

Cross-functional collaboration

Tools

Snowflake

Apache Iceberg

dbt

PySpark

Snowpark

Terraform

Airflow

Kafka

Kinesis

Job description

Redfin is a technology-driven real estate company with the country's most-visited real estate brokerage website. As part of Rocket Companies (NYSE: RKT), Redfin is creating an integrated homeownership platform from search to close to make the dream of homeownership more affordable and accessible for everyone. Redfin's clients can see homes first with on-demand tours, easily apply for a home loan with Rocket Mortgage, and save thousands in fees while working with a top local agent.

We are seeking a Principal Software Engineer to serve as the chief architect and technical north star for our enterprise data organization. In this role, you will design and scale a unified data platform that serves as the central nervous system for the entire company.

You will lead the transition to a modern, multi-tenant Data Lakehouse, abstracting away infrastructure complexity for our data engineers while democratizing high-performance, self-serve access for data scientists, machine learning engineers, and AI agents. You will partner with engineering directors and mentor Staff-level ICs to ensure our architecture scales elegantly securely across domain boundaries.

About the r ole

Lakehouse Architecture & Strategy

Design and implement a unified, open-format Data Lakehouse utilizing a Snowflake-managed Apache Iceberg architecture on AWS S3, transitioning the organization away from disjointed legacy data silos.

Enterprise Data Ingestion

Architect and scale resilient, high-throughput ingestion frameworks. Design batch, micro-batch, and real-time streaming patterns to seamlessly extract data from diverse transactional databases, third-party APIs, and event logs, landing it reliably into our Bronze storage tier.

Multi-Tenant Data Mesh Design

Architect a sovereign, domain-oriented data mesh within a single Snowflake environment. Implement delegated domain administration and sophisticated RBAC/Row-Access Policies to ensure strict infosec compliance without impeding cross-domain data sharing.

Semantic Layer & AI Readiness

Spearhead the deployment of a Universal Semantic Layer on top of our Gold-tier data. Ensure business logic is defined as code to guarantee metric consistency across BI tools, data apps, and downstream LLM/AI agents.

Data Flow & Pipeline Engineering

Define the technical standards for our Medallion (Bronze, Silver, Gold) data flow. Standardize modern ELT patterns utilizing dbt, PySpark, and Snowpark to handle petabyte-scale transformations efficiently.

Infrastructure & Automation

Drive a rigorous Infrastructure-as-Code (IaC) culture using Terraform for all platform provisioning, networking, and security configurations.

Technical Leadership

Act as the ultimate technical escalation point for an organization of 60+ engineers. Mentor Staff and Senior Individual Contributors, lead architecture design reviews, and establish engineering best practices.

Cross-Organization Collaboration

Act as the primary technical liaison to Principal Architects across the broader organization. Define robust integration contracts and connection points between upstream transactional systems, the data platform, and downstream product applications, ensuring a unified, highly interoperable enterprise architecture.

About y ou

Required Qualifications

• Experience: 12+ years of software/data engineering experience, with at least 5+ years operating at a Staff, Principal, or Lead Architect level.
• Cloud & Lakehouse Expertise: Deep, hands-on architectural experience with AWS (S3, IAM, EKS) and Snowflake. Proven experience implementing open table formats, specifically Apache Iceberg.
• Data Ingestion & ELT: Deep expertise with modern data movement pipelines (e.g., Fivetran, Airbyte) and high-velocity event-streaming platforms (e.g., Apache Kafka, AWS Kinesis, Snowpipe). Experience migrating legacy ETL platforms to modern, compute-optimized ELT architectures is highly preferred.
• Data Modeling: Expert understanding of modern data modeling techniques, including Star Schema design for highly optimized analytical reads and dimensional modeling for enterprise semantic layers.
• Processing Frameworks: Advanced proficiency in SQL, Python, and distributed compute engines (Spark, Ray, or native Snowflake compute).
• Data Governance & Security: Extensive experience designing multi-tenant data architectures, implementing complex Role-Based Access Control (RBAC), and managing cross-domain security policies in highly regulated environments.
• CI/CD & IaC: Mastery of CI/CD pipelines (e.g., Azure DevOps, GitHub Actions) and infrastructure provisioning tools (Terraform).

The Ideal Candidate Will Also Have:

• A strong perspective on the evolving "Modern Data Stack" and the tradeoffs between tight vendor coupling versus open-source flexibility.
• Experience integrating data platforms directly with Machine Learning pipelines and AI workflows.
• A proven track record of influencing engineering culture and driving alignment across multiple disparate engineering squ