Senior Data Engineer, Realtime & Batch Pipelines

xAI; Palo Alto (CA); Sur place; USD 180 000 - 330 000; Plein temps

Avantages offerts par ce poste

Equity

Comprehensive medical coverage

Vision and dental coverage

401(k) retirement plan

Disability insurance

Life insurance

Discounts and perks

Résumé du poste

SpaceXSI is seeking a Senior Software Engineer, Data Engineering to help build a distributed data platform powering realtime and batch pipelines at scale. You will work with BigQuery, Trino, ClickHouse for analytics and Flink, Kafka, Spark for streaming and batch processing, partnering with product, safety, and finance teams.

The role owns data correctness end-to-end and requires 5+ years of software engineering experience and fluency in Python/Rust/Scala/Go/Java.

Qualifications

• 5+ years of professional software engineering experience.
• Experience with Python, Rust, Scala, Go or Java and data pipeline tooling.
• Experience with real-time and batch data processing tools.

Responsabilités

• Design, build, and operate real-time and batch data pipelines powering user insights.
• Create shared datasets and internal data products for teams to analyze.
• Prototype tooling to automate data workflows and dashboards.
• Own data correctness end to end: validate outputs and lead root-cause investigations when metrics shift.
• Move across query engines and storage technologies, adapting to new infrastructure.
• Collaborate with product and business teams to identify data gaps and opportunities.
• Iterate quickly with a bias toward efficient, accurate, reliable solutions.

Connaissances

5+ years software engineering

Python, Rust, Scala, Go or Java

Data pipelines & distributed systems

Outils

BigQuery

Trino

ClickHouse

Spark

Kafka

Flink

Description du poste

SpaceXSI is seeking a Senior Software Engineer, Data Engineering to help build a distributed data platform powering realtime and batch pipelines at scale. You will work with BigQuery, Trino, ClickHouse for analytics and Flink, Kafka, Spark for streaming and batch processing, partnering with product, safety, and finance teams.

The role owns data correctness end-to-end and requires 5+ years of software engineering experience and fluency in Python/Rust/Scala/Go/Java.