Senior Multimodal Engineer — Real-Time AI & World Modeling

SpaceXAI; Palo Alto (CA); On-site; USD 180,000 - 440,000; Full time

Benefits offered by this job

Equity

Medical insurance

Vision insurance

Dental coverage

401(k) retirement plan

Disability insurance

Life insurance

Job summary

SpaceXAI is seeking a Member of Technical Staff - Multimodal Understanding to push toward superhuman multimodal intelligence. You will work across vision, audio, video, and text, building data pipelines, training infrastructure, and end‑to‑end product experiences.

You will collaborate with pre‑training, post‑training, and product teams to deliver multimodal reasoning, world modeling, tool use, and interactive human‑AI collaboration at web/petabyte scale.

Qualifications

• Hands-on multimodal pre-training/post-training/fine-tuning experience.
• Expert Python with PyTorch/JAX/XLA.
• Experience building and optimizing large-scale distributed ML systems.
• Deep experience designing data pipelines at scale.
• Strong evaluation frameworks, benchmarks, or RL familiarity.
• Proactive self-starter in high‑intensity environments.
• Willingness to own end‑to‑end initiatives.

Responsibilities

• Design, build, and optimize distributed systems for multimodal pre-training, post-training, inference and data processing.
• Develop high-throughput pipelines for data acquisition, preprocessing, filtering, generation, decoding, loading, and management.
• Advance multimodal capabilities including cross-modal alignment, world modeling, reasoning, and real-time interaction.
• Drive data quality and studies; curate, filter, and scale pipelines for trillion-parameter models.
• Create evaluation frameworks, benchmarks, and metrics capturing real‑world usage and failures.
• Innovate on algorithms, scaling, and co-design for state‑of‑the‑art performance.
• Build tooling, demos, and end-to-end product experiences with rapid iteration.
• Collaborate across pre-training, post-training, and product teams for frontier capabilities.

Skills

Multimodal ML

Python expert

Distributed ML systems

Data pipelines at scale

Evaluation/ RL basics

Self-starter

Tools

PyTorch

JAX

XLA

Rust

C++

Spark

Kubernetes

Ray

Job description

SpaceXAI is seeking a Member of Technical Staff - Multimodal Understanding to push toward superhuman multimodal intelligence. You will work across vision, audio, video, and text, building data pipelines, training infrastructure, and end‑to‑end product experiences.

You will collaborate with pre‑training, post‑training, and product teams to deliver multimodal reasoning, world modeling, tool use, and interactive human‑AI collaboration at web/petabyte scale.