Senior Data Platform Architect

LendingClub; San Francisco (CA); Hybrid; USD 197,000 - 230,000; Full time

Benefits offered by this job

Medical, dental and vision plans

401(k) match

Health and wellness programs

Flexible time off

Parental leave

Job summary

Happen Bank is building a modern data and AI platform on Databricks. As a Principal Data Engineer, you will own the technical architecture and development of platform frameworks that enable secure, scalable data pipelines across teams.

You will lead ingestion architecture, reusable libraries for protection and governance, and infrastructure-as-code practices, while mentoring engineers and driving platform adoption. Hybrid work with in-person collaboration in San Francisco.

Qualifications

• 10+ years of software or data platform engineering experience.
• Bachelor’s degree or higher, or equivalent.
• Strong experience with infrastructure as code (Terraform) and CI/CD.
• Deep experience building ingestion capabilities across diverse data sources.
• Advanced programming skills in Python, SQL, and a JVM language (Scala/Java).
• Deep hands-on expertise with Databricks and related governance capabilities.

Responsibilities

• Own ingestion architecture and define architecture for a declarative, config-driven ingestion framework.
• Lead design and implementation of reusable libraries for policy-driven data protection and audit trails.
• Define infrastructure-as-code practices for safe deployment, rollback, and lifecycle management.
• Drive platform reliability, monitoring, reconciliation, and data validation across pipelines.

Skills

Ingestion architecture

Terraform & CI/CD

Python/SQL/Java

Databricks platform

Security & privacy

Platform observability

Leadership mentoring

Architecture documentation

Stakeholder communication

Education

Bachelor’s degree or higher

Tools

Databricks

Delta Lake

Unity Catalog

Auto Loader

Airflow

Kubernetes

Job description

Happen Bank is building a modern data and AI platform on Databricks. As a Principal Data Engineer, you will own the technical architecture and development of platform frameworks that enable secure, scalable data pipelines across teams.

You will lead ingestion architecture, reusable libraries for protection and governance, and infrastructure-as-code practices, while mentoring engineers and driving platform adoption. Hybrid work with in-person collaboration in San Francisco.