Data Engineer - Real-Time Pipelines & Data Products

xAI

Palo Alto (CA)

On-site

USD 125,000 - 400,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical coverage
Vision coverage
Dental coverage
401(k)
Disability insurance
Life insurance
Discounts

Job summary

xAI in Palo Alto is hiring a Data Engineer to design, build, and operate distributed data platforms powering real-time and batch pipelines for hundreds of events daily.

You will own data correctness, create internal data products, and collaborate with Product, Algorithm, Legal, Finance and Sales to surface gaps and drive data-driven decisions. This role emphasizes end-to-end ownership and pragmatic, scalable solutions.

Qualifications

  • 3+ years of professional software engineering experience, focused on data engineering or distributed systems.
  • Hands-on expertise in Python, Rust, Scala, Go or Java, and data pipeline tooling.
  • Knowledge of realtime and batch data processing tools such as Spark/Kafka/Flink/SQL and storage systems in RMDBs/NoSQL

Responsibilities

  • Design, build, and operate production-grade realtime and batch pipelines ingesting, processing, validating, and delivering data powering analytics and product decisions.
  • Create shared datasets, fact tables, and internal data products for cross-functional teams.
  • Prototype tooling to automate and accelerate internal data workflows (backfills, dashboards, report generation, self-serve data).
  • Own data correctness end to end: invariants, reconciliation, and recomputation; lead root-cause investigations when metrics move unexpectedly.
  • Move across query engines/frameworks (BigQuery, Trino, Clickhouse; Flink, Kafka, Spark/Scalding) adapting to new infra.
  • Partner with product and business to surface data gaps and prioritize high-impact improvements.
  • Iterate quickly, shipping the smallest useful increment with reliable, efficient solutions.

Skills

Python
Rust
Scala
Go
Java
Distributed systems
Data pipelines
Spark
Kafka
Flink
SQL
BigQuery
Trino
ClickHouse

Tools

BigQuery
Trino
ClickHouse
Flink
Kafka
Spark
SQL
Scalding

Job description

xAI in Palo Alto is hiring a Data Engineer to design, build, and operate distributed data platforms powering real-time and batch pipelines for hundreds of events daily.

You will own data correctness, create internal data products, and collaborate with Product, Algorithm, Legal, Finance and Sales to surface gaps and drive data-driven decisions. This role emphasizes end-to-end ownership and pragmatic, scalable solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer — AI-Driven Pipelines & Analytics
Data Engineer — AI-Driven Pipelines & Analytics

present of AI • San Francisco (CA)

On-site
USD 140,000 - 180,000
Data Engineer — Real-Time Analytics & Pipelines
Data Engineer — Real-Time Analytics & Pipelines

SpaceXSI • Palo Alto (CA)

On-site
USD 125,000 - 400,000
Data Engineer - Real-Time Pipelines & AI Infrastructure
Data Engineer - Real-Time Pipelines & AI Infrastructure

Amazon Inc. • Seattle (WA)

On-site
USD 120,000 - 190,000
Senior Platform Data Engineer — Real-Time AI/IoT Pipelines
Senior Platform Data Engineer — Real-Time AI/IoT Pipelines

BrightAI • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Senior IT Data Engineer - Real-Time ETL & Pipelines
Senior IT Data Engineer - Real-Time ETL & Pipelines

xAI • Palo Alto (CA)

On-site
USD 135,000 - 260,000
Equity
Medical, vision & dental
401(k) plan
+3
Data Engineer, Analytics — Build Scalable AI Pipelines
Data Engineer, Analytics — Build Scalable AI Pipelines

OpenAI, Inc. • San Francisco (CA)

On-site
USD 230,000 - 385,000
Senior Data Engineer: Real-Time Data Pipelines & AI
Senior Data Engineer: Real-Time Data Pipelines & AI

AMH • Houston (TX)

On-site
USD 121,000 - 151,000
Medical insurance
Dental & Vision insurance
401(k) with company match
+4
Senior Data Engineer – Real-time Pipelines & Equity
Senior Data Engineer – Real-time Pipelines & Equity

Maven Ventures • Palo Alto (CA)

On-site
USD 180,000 - 330,000
Equity
Medical, Vision & Dental insurance
401(k) retirement plan
+1
Data Engineer: Pipelines & Analytics Lead
Data Engineer: Pipelines & Analytics Lead

OpenAI, Inc. • San Francisco (CA)

On-site
USD 235,000 - 385,000
Relocation assistance
Data Engineer: Scalable Pipelines & AI Data Platforms
Data Engineer: Scalable Pipelines & AI Data Platforms

Resolve Tech Solutions • Irving (TX)

On-site
USD 110,000 - 150,000