Staff Data Engineer

Jobtailor

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

37 hours ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Jobtailor is seeking a senior data engineering leader to shape the data platform across Databricks, streaming, governance, and data products. You will set standards, drive cross-team alignment, and influence roadmaps while mentoring senior engineers and navigating complex multi-squad initiatives.

This role requires 9+ years in data engineering, strong Python/dbt skills, and experience with IaC, Kafka, Flink, and Debezium. Expect collaboration with product and analytics on strategic initiatives.

Qualifications

9+ years of experience as a data engineer in a modern, production-grade cloud data platform.
Exposure across IaC infrastructure, CDC streaming, Databricks operations, data governance, and pipelines.
Track record of cross-team impact and stakeholder alignment.
Strong Python and dbt skills.
Ability to frame ambiguous technical problems and drive them to resolution with minimal guidance.
Knowledge of GDPR, CCPA, SOC2, and FedRAMP is a plus.

Responsibilities

Shape the technical direction and architecture of the data platform across multiple domains.
Identify and resolve cross-cutting technical challenges across data engineering teams and projects.
Define and evolve platform-wide standards, patterns, and abstractions.
Influence roadmaps by framing trade-offs and aligning engineering, product, and analytics.
Drive adoption of changes across teams beyond delivery.
Mentor senior engineers through complex problems and decisions.
Lead multi-squad initiatives with ambiguity and minimal direction.

Skills

Python

dbt

Cross-Team Collaboration

Architectural Judgment

Technical Leadership

Tools

Databricks

Terraform

Kafka

Flink

Debezium

Job description

Shape the technical direction and architecture of the data platform across infrastructure, Databricks, streaming, data products, and governance
Identify and drive resolution of cross-cutting technical challenges across multiple data engineering teams and internal and customer-facing projects
Define and evolve platform-wide standards, patterns, and abstractions adopted across teams
Influence roadmap priorities by framing trade-offs, surfacing opportunities, and driving alignment across engineering, product, and analytics
Drive adoption of changes across teams, not just delivery
Mentor and elevate senior engineers through complex problems and architectural decisions
Navigate ambiguity and lead complex, multi-squad initiatives with minimal direction

Requirements

9+ years of experience as a data engineer in a modern, production-grade cloud data platform
Meaningful exposure across several key platform domains: IaC infrastructure (Terraform/Atmos), CDC streaming (Kafka, Flink, Debezium), Databricks operations, data governance, batch and streaming pipelines, and developer experience
Track record of cross-team impact
Strong Python and dbt skills
Demonstrated ability to frame ambiguous technical problems and drive them to resolution with minimal guidance
Experience navigating organizational complexity and aligning stakeholders
Experience making architectural decisions with long-term, multi-year consequences
Strong technical judgment balanced with pragmatism
Knowledge of compliance and regulatory frameworks such as GDPR, CCPA, SOC2, and FedRAMP (nice-to-have)
Experience designing golden paths and self-service tooling for engineering teams (nice-to-have)

Core Competencies

Demonstrates extensive experience in shaping data platform architecture and driving cross-team collaboration, with a strong focus on data governance, streaming technologies, and compliance frameworks. Proven ability to mentor engineers and navigate complex organizational structures to achieve strategic goals.

Highest-signal resume keywords