Lead Data Engineer — Financial Data Pipelines & AI Automation

LendingClub; San Francisco (CA); Hybrid; USD 190,000 - 220,000; Full time

Benefits offered by this job

Equity and annual bonus opportunities

Medical, dental and vision plans

401(k) match and wellness programs

Flexible time off and parental leave

Job summary

Happen Bank is hiring a Lead Data Engineer in San Francisco to own and optimize critical financial data pipelines powering month-end close, investor reporting, and revenue recognition. You will lead a mixed onshore/offshore team, collaborate with finance and operations, and advance automation and AI-driven tooling.

You will mentor engineers, implement data quality standards, and drive observability across data workflows in a hybrid work model with in-office days.

Qualifications

• 7+ years of experience in data engineering and 2+ years leading teams.
• Hands-on with AI tools to accelerate work and quality.
• Strong expertise in SQL, data modeling, data warehouse concepts, and scalable pipelines.
• Experience with orchestration tools (Airflow/Oozie/Dagster) and distributed processing (Spark/PySpark).
• Working knowledge of AWS services (EMR, S3, Redshift) and platforms like Snowflake or Databricks.
• Own outcomes, identify risks early, and communicate across teams.
• Experience mentoring offshore teams and working across time zones.

Responsibilities

• Lead a cross-functional scrum team of onshore and offshore data engineers.
• Own architecture, maintenance, and improvement of financial data pipelines for GL automation, reporting, and tax documents.
• Partner with finance, accounting, and operations to translate requirements into scalable solutions.
• Drive adoption of modern data platform capabilities and AI-driven improvements.
• Build monitoring, alerting, and observability for reliability and rapid incident response.
• Establish coding standards and data quality frameworks at scale.
• Create AI-driven runbooks and self-service tools for faster troubleshooting.

Skills

SQL & data modeling

Data pipelines

Leadership

Cloud & AWS

Databricks / Spark

Orchestration (Airflow / Dagster)

dbt

AI tools in development

Data warehousing

Communication

Education

Bachelor's degree in a related field

Tools

Databricks

Dagster

Airflow

Spark

PySpark

Redshift

Snowflake

AWS

dbt

Elementary

Job description

Happen Bank is hiring a Lead Data Engineer in San Francisco to own and optimize critical financial data pipelines powering month-end close, investor reporting, and revenue recognition. You will lead a mixed onshore/offshore team, collaborate with finance and operations, and advance automation and AI-driven tooling.

You will mentor engineers, implement data quality standards, and drive observability across data workflows in a hybrid work model with in-office days.