Principal Data Platform Engineer — Data Infrastructure

Happen Inc; San Francisco (CA); On-site; USD 197,000 - 230,000; Full time

Job summary

Happen Bank is seeking a Principal Data Engineer to own the architecture and development of our data platform frameworks and infrastructure on Databricks. You will enable downstream pipelines, implement secure ingestion, and drive production readiness through configuration-driven approaches.

The role emphasizes framework and platform engineering over pipeline delivery, with a focus on onboarding data sources, protecting sensitive information, and promoting work to production using scalable,

Qualifications

• 10+ years of software or data platform engineering experience with platform-level frameworks
• Experience designing and delivering infrastructure and libraries used across multiple teams
• Strong experience with infrastructure as code and CI/CD pipelines for data platforms
• Deep expertise in ingestion, CDC, schema evolution, and protecting production systems

Responsibilities

• Define architecture for declarative, configuration-driven ingestion framework
• Build reusable, versioned libraries for data protection and governance
• Define IaC standards for safe deployment, rollback, and lifecycle management
• Drive platform reliability with monitoring, alerts, and data validation
• Lead architectural decisions and tradeoffs with stakeholders
• Mentor senior engineers and establish best practices across platforms

Skills

Platform engineering

Python

SQL

Spark

Databricks

Terraform

CI/CD

Data governance

Security

Observability

Education

Bachelor's degree or higher

Tools

Databricks platform

Delta Lake

Unity Catalog

Auto Loader

Spark UDFs

Terraform

Job description

Happen Bank is seeking a Principal Data Engineer to own the architecture and development of our data platform frameworks and infrastructure on Databricks. You will enable downstream pipelines, implement secure ingestion, and drive production readiness through configuration-driven approaches.

The role emphasizes framework and platform engineering over pipeline delivery, with a focus on onboarding data sources, protecting sensitive information, and promoting work to production using scalable,