Data Engineer – Real-Time & Batch Data Platform

xAI; Palo Alto (CA); On-site; USD 125,000 - 400,000; Full time

Benefits offered by this job

Equity

Medical insurance

Vision insurance

Dental insurance

401(k) retirement plan

Disability insurance

Life insurance

Employee discounts

Job summary

xAI is seeking a Data Engineer to join its product engineering team in Palo Alto. You will build and operate distributed data platforms powering both real-time and batch pipelines at scale, delivering data products and insights to product, growth, safety, and business teams.

The role requires hands-on expertise in modern data tooling and languages, with a focus on reliability, performance, and cross-functional collaboration.

Qualifications

• 3+ years of professional software engineering experience, ideally in data engineering or distributed systems.
• Hands-on experience with Python, Rust, Scala, Go or Java and data pipeline tooling.
• Experience with real-time and batch data processing tools and distributed storage systems.

Responsibilities

• Design, build, and operate production-grade realtime and batch pipelines that ingest, process, validate, and deliver data powering user-behavior insights and product decisions.
• Create shared datasets, fact tables, and internal data products for analysis and product improvements.
• Prototype and build tooling to automate internal data workflows and self-serve data access.
• Own data correctness end-to-end, validate invariants, reconcile denominators, recompute, and investigate root causes when metrics shift.
• Move across query engines and frameworks (BigQuery, Trino, Clickhouse; Flink, Kafka, Spark/Scalding) as needed.
• Collaborate with product and business teams to identify data gaps and prioritize high-impact data acquisitions.
• Iterate quickly on feedback to ship small, useful increments with reliability.

Skills

Python

Rust

Scala

Go

Java

Data pipelines

Distributed systems

Tools

Spark

Kafka

Flink

SQL

Job description

xAI is seeking a Data Engineer to join its product engineering team in Palo Alto. You will build and operate distributed data platforms powering both real-time and batch pipelines at scale, delivering data products and insights to product, growth, safety, and business teams.

The role requires hands-on expertise in modern data tooling and languages, with a focus on reliability, performance, and cross-functional collaboration.