Senior Multimodal AI Engineer — Real-Time, Large-Scale Systems

Maven Ventures; Palo Alto (CA); On-site; USD 180,000 - 440,000; Full time

Job summary

SpaceXSI in Palo Alto seeks a Sr. Software Engineer, Multimodal Understanding, to advance multimodal intelligence across image, video, audio, and text. You will contribute to data collection, model training, and end-to-end product experiences.

Collaborate with cross-functional teams to push frontier capabilities in reasoning, world modeling, tool use, and agentic AI, building scalable systems and demos that operate in real time.

Qualifications

• Experience with multimodal pre-training, post-training, or fine-tuning across vision, audio, or video.
• Strong background in building and optimizing large-scale distributed ML systems.

Responsibilities

• Design, build, and optimize large-scale distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web/petabyte scale
• Develop high-throughput pipelines for data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management (images, videos, audio + text)
• Advance multimodal capabilities including spatial-temporal compression, cross-modal alignment, world modeling, reasoning, emergent abilities, audio/image/video understanding & generation, real-time video processing, and noisy data handling
• Drive data quality and studies: curation (human/synthetic), filtering techniques, analysis, and scalable pipelines to support trillion-parameter models
• Create evaluation frameworks, internal benchmarks, reward models, and metrics that capture real-world usage, failure modes, interactive dynamics, and human-AI synergy
• Innovate on algorithms, modeling approaches, hardware/software/algorithm co-design, and scaling paradigms for state-of-the-art performance
• Build research tooling, user-friendly interfaces, prototypes/demos, full-stack applications, and enable rapid iteration based on feedback
• Work across the stack (pre-training → SFT/RL/post-training) to enable reasoning, tool calling, agentic behaviors, orchestration, and seamless real-time interactions

Skills

Multimodal pre-training

Python

PyTorch

JAX

XLA

Distributed ML systems

Data pipelines

RL / reward modeling

Rust/C++ for performance

Spark

Ray

Kubernetes

Full‑stack tooling

Tools

Spark

Ray

Kubernetes

Job description

SpaceXSI in Palo Alto seeks a Sr. Software Engineer, Multimodal Understanding, to advance multimodal intelligence across image, video, audio, and text. You will contribute to data collection, model training, and end-to-end product experiences.

Collaborate with cross-functional teams to push frontier capabilities in reasoning, world modeling, tool use, and agentic AI, building scalable systems and demos that operate in real time.