Senior Architect, Multimodal Pre-Training

Walden Robotics; Cambridge (MA); On-site; USD 230,000 - 460,000; Full time

Benefits offered by this job

Salary

Annual cash bonus

Company equity

Company-subsidized insurance programs

401(k) with company match

Flexible PTO

Daily lunch

Other benefits

Job summary

Walden Robotics is seeking a senior technical leader to guide pre-training for omni-models at massive scale. You will own architecture, objective definitions, and data mixtures while collaborating with the AI leadership to push model capabilities.

You will partner across research and production teams, shaping the research agenda and mentoring teammates as we advance multi-modal training and scalable systems in a fast-paced environment.

Qualifications

• Deep, hands-on experience pre-training large models—LLM, VLM, multimodal, or VLA.
• Experience training across multiple objectives or modalities and balancing them.
• Hands-on experience with generative modeling of images and/or video.
• Fluency with scaling laws, distributed training, and the practical failure modes of massive runs.
• A track record of setting direction others build on, and bridging research with production-grade code.

Responsibilities

• Pre-Training Roadmap: Help drive the pre-training agenda for omni-models spanning language, vision-language, video, and action, in close partnership with the AI team.
• Omni-Model Objectives: Train a single model across a wide range of losses (LLM, VLM, video and image generation) at massive scale, and decide how to weight and balance them.
• Core Modeling: Lead modeling work across architecture, tokenization, and the scaling-law analysis behind compute allocation.
• Data & Infrastructure: Turn petabyte-scale text, image, and video data into training-ready mixtures with the data and infra teams.
• Technical Leadership: Help raise the bar on training reliability and evaluation, support and mentor teammates, and bring frontier ideas into our stack quickly.

Skills

Large-scale pre-training

Multi-objective training

Generative models

Scaling & systems

Technical leadership

Job description

Walden Robotics is seeking a senior technical leader to guide pre-training for omni-models at massive scale. You will own architecture, objective definitions, and data mixtures while collaborating with the AI leadership to push model capabilities.

You will partner across research and production teams, shaping the research agenda and mentoring teammates as we advance multi-modal training and scalable systems in a fast-paced environment.