Principal Data Platform Engineer - Ingestion & Security

Happen Bank; San Francisco (CA); Hybrid; USD 197,000 - 230,000; Full time

Benefits offered by this job

Medical, dental, and vision plans

401(k) match

Parental leave (up to 16 weeks)

Flexible time off

Job summary

Happen Bank in San Francisco is hiring a Principal Data Engineer to own the technical architecture of the modern data platform and its downstream pipelines. You will enable teams to onboard new data sources, protect sensitive information, and promote work to production via configuration rather than custom code.

The role emphasizes platform engineering over pipeline delivery, with leadership responsibility to raise standards, mentor engineers, and drive reusable, scalable capabilities across

Qualifications

• 10+ years of software or data platform engineering experience.
• Strong experience with infrastructure as code (Terraform) and CI/CD pipelines.
• Experience building ingestion capabilities across diverse data sources.
• Advanced programming skills in Python, SQL, and a JVM language (Scala/Java).
• Deep hands-on expertise with Databricks, including Delta Lake and governance capabilities.

Responsibilities

• Own ingestion architecture: define the vision for a declarative, configuration-driven ingestion framework.
• Build scalable platform frameworks: design reusable libraries with policy-driven data protection and audit trails.
• Set infrastructure and deployment standards: implement IaC practices for safe deployment and lifecycle management.
• Drive platform reliability and observability: establish monitoring, alerting, data validation, and recovery capabilities.
• Lead evidence-based technology decisions: run proofs of concept, document tradeoffs, and engage vendors as needed.
• Drive cross-functional platform delivery: translate challenges into clear requirements and phased delivery plans.
• Raise engineering standards: mentor engineers and establish best practices for testing, documentation, and release management.

Skills

Ingestion architecture

Platform frameworks

Terraform & CI/CD

Databricks

Python

SQL

Java/Scala

Security & privacy

Observability

Leadership

Education

Bachelor's degree or higher

Tools

Databricks

Terraform

CI/CD pipelines

Delta Lake

Unity Catalog

Auto Loader

Job description

Happen Bank in San Francisco is hiring a Principal Data Engineer to own the technical architecture of the modern data platform and its downstream pipelines. You will enable teams to onboard new data sources, protect sensitive information, and promote work to production via configuration rather than custom code.

The role emphasizes platform engineering over pipeline delivery, with leadership responsibility to raise standards, mentor engineers, and drive reusable, scalable capabilities across