Senior Data Platform Engineer — Lakehouse & Spark Expert

RiseMe; San Francisco (CA); Hybrid; USD 165,000 - 185,000; Full time

Benefits offered by this job

Unlimited PTO

Excellent medical, dental, and vision

Employee Equity and Stock Purchase

Employee Discounts

Virtual Wellness Classes

Pet Insurance

Job summary

Zeta Global is seeking a Senior Data Platform Engineer to design, build, and operate data infrastructure that powers analytics, ML, and AI across the product. You will own Lakehouse, Spark, and related systems, partnering with data scientists and engineers across teams to ensure secure, scalable, and cost-effective data processing.

The role is hybrid and based in the San Mateo or San Francisco area, offering opportunities to influence platform reliability and drive innovation in data tooling and

Qualifications

• 7+ years of software engineering experience.
• Experience with Spark or another distributed data-processing framework.
• Experience building or operating production data platforms, backend systems, or distributed systems.
• Familiarity with Lakehouse architecture, Apache Iceberg, data quality, governance, lineage, metadata, query engines, or real-time OLAP.
• Strong analytical, communication, and collaboration skills.

Responsibilities

• Build and operate Lakehouse, Spark, and distributed data-processing systems.
• Improve the performance, reliability, cost, and operational visibility of platform workloads.
• Develop capabilities for data quality, governance, lineage, metadata, discoverability, security, and access control.
• Build the data context required for trusted reporting, ML models, and AI agents.
• Evaluate compute and query engines for read-heavy workloads, assessing cost, performance, reliability, and operational fit.
• Assess real-time OLAP technologies and identify appropriate production use cases.
• Improve deployment, observability, incident response, developer tooling, and platform operations.
• Partner with data scientists and data engineers to improve their experience using the platform.
• Contribute fixes and improvements to relevant open-source projects, including Spark, Iceberg, and Airflow.
• Mentor engineers through code reviews, pairing, design discussions, and knowledge-sharing sessions.

Skills

Strong analytical

Communication

Collaboration

Tools

Python

Scala

Java

Spark

AWS

Kubernetes

Terraform

Airflow

Trino

Iceberg

Pinot

Job description

Zeta Global is seeking a Senior Data Platform Engineer to design, build, and operate data infrastructure that powers analytics, ML, and AI across the product. You will own Lakehouse, Spark, and related systems, partnering with data scientists and engineers across teams to ensure secure, scalable, and cost-effective data processing.

The role is hybrid and based in the San Mateo or San Francisco area, offering opportunities to influence platform reliability and drive innovation in data tooling and