Research Scientist – Multimodal Foundation Models & Visual Reasoning

Elorian

Palo Alto (CA)

On-site

USD 180,000 - 300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Elorian in Palo Alto is seeking a Ph.D.-level researcher to lead ambitious, high-impact research across next-generation model architectures, distributed training, multimodal visual reasoning, and data-centric learning. You will design experiments, justify hypotheses, and collaborate with world-class peers to translate breakthroughs into scalable foundation models.

Work with dedicated compute clusters and deep engineering support to push the boundary of visual intelligence and deploy capabilities

Qualifications

  • Ph.D. or equivalent industry research track record in ML, CV, NLP, or related field.
  • Foundational understanding of deep learning, transformers, and large-scale training dynamics.
  • Proficiency in Python and PyTorch or JAX.
  • Ability to independently define research agendas and run rigorous experiments.

Responsibilities

  • Frontier research at the intersection of foundation models and multimodal understanding.
  • Design novel architectures, pre-training methods, and scalable post-training techniques.
  • Design, run and analyze large-scale distributed training experiments.
  • Develop data pipelines and evaluation suites for frontier models.
  • Collaborate with cross-functional teams to deploy breakthroughs at scale.

Skills

Machine learning
Computer vision
NLP
Python
PyTorch
JAX
Transformers
Empirical research

Education

Ph.D. or equivalent industry research track record

Tools

Megatron-LM
DeepSpeed
Ray

Job description

About Us

We are a well-funded, early-stage AI research and product lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers—including Andrew Dai, previously an engineering leader on Gemini—our mission is to push the frontier of visual and multimodal intelligence. Our first model, Glimpse, launched publicly in October 2026.

Our team currently consists of 25 world-class scientists and engineers. We raised a $55M seed round led by Altimeter Capital, Menlo Ventures, Striker VC, and NVIDIA. We are tackling foundational problems in artificial intelligence and translating cutting-edge multimodal research into scalable, real-world systems.

About the role

In this role, you will lead ambitious, high-impact research across next-generation model architectures, distributed training methodologies, multimodal visual reasoning, reinforcement learning, and data-centric learning. Backed by dedicated, large-scale compute clusters and deep engineering support, you will formulate first-principles hypotheses and run large-scale empirical experiments. You will collaborate closely with world-class research and engineering peers to push the boundary of visual intelligence and translate core research breakthroughs directly into state-of-the-art foundation models and real-world capabilities.

What you will do
  • Frontier Research: Drive novel research at the intersection of foundation models, multimodal understanding, complex visual reasoning, and spatial intelligence.

  • Architecture & Training Innovations: Conceive and build novel model architectures, pre-training methodologies, and scalable post-training techniques (e.g., preference tuning, reasoning-focused RL) to systematically advance model capabilities.

  • Large-Scale Experimentation: Design, execute, and analyze large-scale distributed training experiments on modern accelerator clusters to push the frontier of model performance.

  • Data-Centric Intelligence: Pioneer innovative approaches to multimodal data curation, synthetic data generation, automated filtering, and rigorous benchmark evaluation.

  • Breakthrough to Capability: Collaborate with cross-functional research and systems engineering teams to turn fundamental algorithmic breakthroughs into robust, scalable foundation model capabilities deployed at scale.

What we are looking for
  • Ph.D. or equivalent industry research track record in Machine Learning, Computer Vision, Natural Language Processing, or a related quantitative discipline.

  • Rigorous foundational understanding of deep learning principles, transformer/multimodal architectures, and modern large-scale training dynamics.

  • Deep proficiency in Python and modern deep learning frameworks (PyTorch or JAX).

  • Demonstrated ability to independently define research agendas, design rigorous empirical experiments, and solve open-ended, frontier-level problems.

Nice to have
  • Specialized Domain Expertise: Deep theoretical and practical expertise in at least one of the following: foundation models, multimodal reasoning, visual/spatial intelligence, reinforcement learning, or post-training

  • Proven Research Impact: Strong track record demonstrated through first-author publications at top-tier venues (e.g. NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or key technical contributions to high-profile foundation model releases.

  • Distributed Systems & Scale: Hands-on experience training, profiling, and scaling models across large distributed GPU or TPU clusters (e.g., FSDP, Megatron-LM, DeepSpeed, Ray).

  • Data & Evaluation: Demonstrated experience developing large-scale multimodal data pipelines, synthetic reasoning trace generation, or designing rigorous evaluation suites for frontier models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist – Multimodal Foundation Models & Visual Reasoning
Research Scientist – Multimodal Foundation Models & Visual Reasoning

Elorian • Iowa

On-site
USD 140,000 - 190,000
Research Engineer – Robotics & Embodied AI
Research Engineer – Robotics & Embodied AI

Elorian • Iowa

On-site
USD 120,000 - 210,000
Research Engineer – Robotics & Embodied AI
Research Engineer – Robotics & Embodied AI

Elorian • Palo Alto (CA)

On-site
USD 150,000 - 230,000
Software Engineer - Core Platform
Software Engineer - Core Platform

Core Platform @ Elorian • Palo Alto (CA)

On-site
USD 250,000 - 450,000
Research Scientist - Multimodal Foundation Models
Research Scientist - Multimodal Foundation Models

Kindredventures • San Francisco (CA)

On-site
USD 180,000 - 300,000
Research Scientist – Multimodal Foundation Models
Research Scientist – Multimodal Foundation Models

Mecka • San Francisco (CA)

On-site
USD 185,000 - 210,000
Software Engineer - Applications
Software Engineer - Applications

Digitailor • Palo Alto (CA)

On-site
USD 250,000 - 400,000
Significant equity
Health insurance
Perks
Software Engineer - Core Platform
Software Engineer - Core Platform

Elorian • Palo Alto (CA)

Hybrid
USD 300,000 - 450,000
Equity stake
Full health benefits
Hybrid work (3 days in-office)
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →

Mecka • New York (NY)

On-site
USD 140,000 - 230,000
AI Researcher
AI Researcher

Pivots Hiring • San Mateo (CA)

On-site
USD 180,000 - 240,000