Multimodal Foundation Model Engineer: Pretraining & Scaling

Hark; San Jose (CA); On-site; USD 180,000 - 450,000; Full time

Job summary

Hark is building the next generation of AI experiences with multimodal models and specialized hardware. The Omni team is responsible for developing multimodal foundation models, spanning data curation, mixture design, model architecture, scaling, distributed training, and evaluation to enable real-time, cross-modal reasoning and response capabilities.

You will research architectures, design experiments, and implement training recipes with data researchers and training engineers to push the

Qualifications

• Hands-on experience training large models with trade-offs between quality, compute cost, and stability.
• Strong experimental judgment including controlled experiments to distinguish hypotheses.
• Experience applying scaling laws to experiment design and extrapolations.
• Experience implementing and debugging distributed training workloads across GPU clusters.

Responsibilities

• Research model architecture, optimization, and scaling for large models.
• Establish baselines and run controlled experiments to evaluate changes at scale.
• Develop training recipes, including learning-rate schedules, context lengths, and compute allocation.
• Investigate mixture-of-experts architectures, hybrid attention, and long-context training.
• Diagnose loss spikes and numerical issues with training engineers.

Skills

Large-model training

Experimental design

Distributed training

Research & engineering

Job description

Hark is building the next generation of AI experiences with multimodal models and specialized hardware. The Omni team is responsible for developing multimodal foundation models, spanning data curation, mixture design, model architecture, scaling, distributed training, and evaluation to enable real-time, cross-modal reasoning and response capabilities.

You will research architectures, design experiments, and implement training recipes with data researchers and training engineers to push the