Senior Data Platform Engineer - Real-Time, Petabyte-Scale

Maven Ventures; Palo Alto (CA); In loco; USD 180.000 - 330.000; Tempo pieno

Vantaggi offerti da questo lavoro

equity opportunities

comprehensive medical, vision & dent

401(k) retirement plan

short & long-term disability

life insurance

Descrizione del lavoro

SpaceXSI is building a Data Platform to support real-time ML pipelines and analytics at petabyte scale. The Senior Software Engineer will design, build, and operate distributed systems powering data movement and compute across the company.

You will own infrastructure components handling trillions of events daily, driving scalability, performance, and reliability for product and ML workloads.

Competenze

• Bachelor's degree in computer science, engineering, math, or technical discipline; OR 5+ years of professional software development experience in lieu of a degree.
• Experience with Kafka, Flink, Spark, Trino, or Hadoop in production.

Mansioni

• Design and implement high-throughput, low-latency data ingestion and transport systems.
• Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads.
• Extend and tune Spark, Flink, and Trino for demanding production pipelines.
• Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale.
• Debug and optimize distributed systems, with a focus on reliability and performance under load.
• Collaborate with ML, product, and infrastructure teams to unblock critical data workflows.

Conoscenze

Rust/Go/Scala

Distributed systems

Debugging & performance

Data platform expertise

Formazione

Bachelor's degree in CS or related field

5+ years experience in lieu of degree

Strumenti

Kafka

Flink

Spark

Trino

Descrizione del lavoro

SpaceXSI is building a Data Platform to support real-time ML pipelines and analytics at petabyte scale. The Senior Software Engineer will design, build, and operate distributed systems powering data movement and compute across the company.

You will own infrastructure components handling trillions of events daily, driving scalability, performance, and reliability for product and ML workloads.