Senior Multimodal AI Engineer

Maven Ventures; Palo Alto (CA); Sur place; USD 180 000 - 440 000; Plein temps

Résumé du poste

SpaceXSI is seeking a Sr. Model Engineer, Multimodal Understanding, to push toward superhuman multimodal intelligence. You will design and optimize large-scale systems for pre-training, post-training, inference, and data handling across images, video, audio, and text.

You will collaborate with cross-functional teams to advance capabilities in reasoning, world modeling, and tool use, delivering end-to-end research demos and products in real time.

Qualifications

• Production-quality coding in Python, PyTorch, JAX, Rust or C++.
• Experience training large models (1B+ parameters) including pretraining/post-training.

Responsabilités

• Design and optimize large-scale distributed multimodal pre-training, post-training, inference, data processing, and tokenization at web/petabyte scale.
• Develop high-throughput pipelines for data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management (images, videos, audio + text).
• Advance multimodal capabilities including spatial-temporal compression, cross-modal alignment, world modeling, reasoning, emergent abilities, audio/image/video understanding & generation, real-time video processing, and noisy data handling.
• Drive data quality and studies: curation (human/synthetic), filtering techniques, analysis, and scalable pipelines to support trillion-parameter models.
• Create evaluation frameworks, internal benchmarks, reward models, and metrics that capture real-world usage, failure modes, interactive dynamics, and human-AI synergy.
• Innovate on algorithms, modeling approaches, hardware/software/algorithm co-design, and scaling paradigms for state-of-the-art performance.
• Build research tooling, user-friendly interfaces, prototypes/demos, full-stack applications, and enable rapid iteration based on feedback.
• Work across the stack (pre-training → SFT/RL/post-training) to enable reasoning, tool calling, agentic behaviors, orchestration, and seamless real-time interactions.

Connaissances

Python

PyTorch

JAX

Rust

C++

Distributed ML systems

Data pipelines

RL techniques

Agentic systems

Outils

Spark

Ray

Kubernetes

Description du poste

SpaceXSI is seeking a Sr. Model Engineer, Multimodal Understanding, to push toward superhuman multimodal intelligence. You will design and optimize large-scale systems for pre-training, post-training, inference, and data handling across images, video, audio, and text.

You will collaborate with cross-functional teams to advance capabilities in reasoning, world modeling, and tool use, delivering end-to-end research demos and products in real time.