Multimodal AI Engineer: Vision, Video & Audio

SpaceX Super Intelligence; Palo Alto (CA); On-site; USD 180,000 - 440,000; Full time

Benefits offered by this job

Equity

Health benefits (medical, vision, and—

401(k) retirement plan

Disability insurance

Life insurance

Discounts

Job summary

SpaceXSI is building a comprehensive multimodal AI stack and seeks a multimodal engineer for the Imagine Model Team. You will develop experiences that understand and generate across image, video, and optional audio, spanning data curation, modeling, training, inference serving, and product integration.

This role covers pretraining and post-training phases with close collaboration with product teams to push frontiers and deliver excellent user experiences.

Qualifications

• Track record in leading studies that significantly improve neural network capabilities and performance through better data or modeling.
• Experience in data-driven experiment designs, systematic analysis, and iterative model debugging.
• Experience developing or working with large-scale distributed machine learning systems.
• Ability to deliver optimal end-to-end user experiences.
• Hands-on contributor with initiative, excellence, strong work ethic, prioritization skills, and excellent communication.

Responsibilities

• Create and drive engineering agendas to advance multimodal capabilities, with emphasis on image and video generation, editing, understanding, controllable/long-horizon synthesis, agentic planning, RL training, and world simulation (including audio integration for richer video experiences).
• Improve data quality through annotation, filtering, augmentation, synthetic generation, captioning, and in-depth data studies, particularly for visual and audio data.
• Design evaluation frameworks, metrics, benchmarks, evals, and reward models tailored to image/video/audio quality and coherence.
• Implement efficient algorithms for state-of-the-art model performance, including real-time inference, distillation, and scalable serving for visual content.
• Develop scalable data collection and processing pipelines for multimodal (primarily image/video-focused) datasets.
• Collaborate cross-functionally to integrate AI solutions into production and rapidly iterate based on user feedback.

Skills

Neural networks

Data-driven experiments

Distributed ML systems

End-to-end UX delivery

Communication

Tools

Python

JAX/XLA

PyTorch

Rust/C++

Spark

Ray

Job description

SpaceXSI is building a comprehensive multimodal AI stack and seeks a multimodal engineer for the Imagine Model Team. You will develop experiences that understand and generate across image, video, and optional audio, spanning data curation, modeling, training, inference serving, and product integration.

This role covers pretraining and post-training phases with close collaboration with product teams to push frontiers and deliver excellent user experiences.