Staff Data Platform Engineer — Lakehouse & AI

Hidden Road

United States

Hybrid

USD 212,000 - 265,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Bi-weekly all-company meeting
Catered lunches, fully-stocked kitchen
Professional development budget

Job summary

Ripple is seeking a Staff Software Engineer on the Data Engineering team to set the technical direction for the Caspian Data Platform. You will own ingestion, transformation, governance, and data quality across the platform, remaining deeply hands-on while raising the bar for the team.

You will lead architecture decisions for production-grade Databricks pipelines, establish data quality benchmarks, and guide cross-team initiatives. Strong focus on AI integration and code quality.

Qualifications

  • 10+ years of data engineering experience, with a strong track record of architecting and operating data platforms at scale, while remaining deeply hands-on.
  • Deep mastery of Databricks — Delta Live Tables, Unity Catalog, Delta Lake, and Spark.
  • Demonstrated ownership of ingestion, transformation, governance, and data quality across a production platform.
  • Expert in SQL and Python, applied to complex data modeling, transformation, and platform tooling.
  • Strong AWS experience operating data systems at scale.
  • A history of being the technical bar raiser — setting standards and patterns that other engineers build on, and lifting the quality of everyone around you.
  • Experience driving AI tooling into data engineering workflows — building agentic systems, integrating LLMs into developer workflows, or enabling conversational analytics.
  • The ability to influence through technical credibility and translate tradeoffs for both engineers and leadership.

Responsibilities

  • Lead the design of the core pillars of the platform — ingestion, transformation, governance, and data quality — and build the most critical components yourself.
  • Define the engineering patterns and reference architectures for Databricks pipelines, and stay hands-on shipping production flows, writing the reference implementations, and prototyping the hard parts before the team scales them.
  • Establish the benchmark for data quality and governance — expectations, data contracts, lineage, validation frameworks — and hold the team to it through building and code review.
  • Lead the most complex, ambiguous initiatives that span multiple quarters and teams, from problem statement to delivered capability.
  • Lead the technical direction for applying AI across data engineering. This includes agentic systems for pipeline operations, automated transformation generation, and self-serve analytics interfaces. Develop the first versions yourself.
  • Act as the quality standard bearer: raise code quality, build rigor, and engineering judgment across the team, and mentor senior engineers into greater ownership.

Skills

Databricks
SQL
Python
AWS
Data platforms

Tools

Delta Live Tables
Unity Catalog
Delta Lake
Spark

Job description

Ripple is seeking a Staff Software Engineer on the Data Engineering team to set the technical direction for the Caspian Data Platform. You will own ingestion, transformation, governance, and data quality across the platform, remaining deeply hands-on while raising the bar for the team.

You will lead architecture decisions for production-grade Databricks pipelines, establish data quality benchmarks, and guide cross-team initiatives. Strong focus on AI integration and code quality.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Data Platform Engineer — AI-Driven Lakehouse Leader
Staff Data Platform Engineer — AI-Driven Lakehouse Leader

Ripple • San Francisco (CA)

On-site
USD 212,000 - 265,000
Staff Data Engineer - AI-Driven Analytics Platform Lead
Staff Data Engineer - AI-Driven Analytics Platform Lead

Ripple • San Francisco (CA)

On-site
USD 208,000 - 260,000
Competitive salary
Bonuses and equity
Wellness reimbursement
+1
Staff Data Platform Engineer – AI‑Driven Data Ops
Staff Data Platform Engineer – AI‑Driven Data Ops

Unchain Data • San Francisco (CA)

Hybrid
USD 208,000 - 260,000
Professional development budget
Competitive salary and benefits
Generous vacation policy
+1
Staff Data Platform Engineer — AI‑Driven Pipelines
Staff Data Platform Engineer — AI‑Driven Pipelines

P2P • United States

On-site
USD 208,000 - 260,000
Competitive salary
Bonuses
Equity
+2
Senior Databricks Data Engineer — Lakehouse & AI Pipelines
Senior Databricks Data Engineer — Lakehouse & AI Pipelines

Livefront • Northern (KY)

Hybrid
USD 150,000 - 180,000
Staff Software Engineer, Data Engineering
Staff Software Engineer, Data Engineering

Unchain Data • San Francisco (CA)

Hybrid
USD 208,000 - 260,000
Professional development budget
Competitive salary and benefits
Generous vacation policy
+1
Senior Data Platform Engineer - Lakehouse & Databricks
Senior Data Platform Engineer - Lakehouse & Databricks

Ranger Technical Resources • Town of Florida (NY)

On-site
USD 130,000 - 185,000
Staff Software Engineer, Data Engineering
Staff Software Engineer, Data Engineering

P2P • United States

On-site
USD 208,000 - 260,000
Competitive salary
Bonuses
Equity
+2
Staff Software Engineer, Data Engineering
Staff Software Engineer, Data Engineering

Hidden Road • United States

Hybrid
USD 212,000 - 265,000
Bi-weekly all-company meeting
Catered lunches, fully-stocked kitchen
Professional development budget
Staff Software Engineer, Data Engineering
Staff Software Engineer, Data Engineering

Ripple • San Francisco (CA)

On-site
USD 208,000 - 260,000
Competitive salary
Bonuses and equity
Wellness reimbursement
+1