Research Scientist – Multimodal Foundation Models & Visual Reasoning

Elorian

Iowa

On-site

USD 140,000 - 190,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Elorian is seeking a PhD-level researcher to lead frontier AI research across foundation models, multimodal reasoning, and distributed training. You will formulate hypotheses, run large-scale experiments, and translate breakthroughs into scalable capabilities for real-world use.

Collaborations across research and systems engineering teams will turn novel architectures and data-centric methods into robust models deployed at scale, with dedicated compute and engineering support.

Qualifications

  • Ph.D. or equivalent industry research track record in ML, CV, NLP, or related quantitative discipline.
  • Deep understanding of deep learning, transformers, and large-scale training dynamics.
  • Proficiency in Python and modern DL frameworks (PyTorch or JAX).
  • Ability to define research agendas, design rigorous experiments, and solve frontier problems.

Responsibilities

  • Drive frontier research at the intersection of foundation models, multimodal understanding, and complex visual reasoning.
  • Design and prototype novel model architectures and scalable training methodologies.
  • Plan and execute large-scale distributed training experiments on accelerator clusters.
  • Advance data-centric intelligence, synthetic data generation, and rigorous benchmark evaluation.
  • Collaborate with cross-functional teams to translate research breakthroughs into scalable capabilities.

Skills

Python programming
Deep learning fundamentals
Transformer models
Multimodal understanding
Empirical research

Education

Ph.D. in ML/CV/NLP or related field

Tools

PyTorch
JAX
Megatron-LM
DeepSpeed
Ray

Job description

About Us

We are a well-funded, early-stage AI research and product lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers—including Andrew Dai, previously an engineering leader on Gemini—our mission is to push the frontier of visual and multimodal intelligence. Our first model, Glimpse, launched publicly in October 2026.

Our team currently consists of 25 world-class scientists and engineers. We raised a $55M seed round led by Altimeter Capital, Menlo Ventures, Striker VC, and NVIDIA. We are tackling foundational problems in artificial intelligence and translating cutting-edge multimodal research into scalable, real-world systems.

About the role

In this role, you will lead ambitious, high-impact research across next-generation model architectures, distributed training methodologies, multimodal visual reasoning, reinforcement learning, and data-centric learning. Backed by dedicated, large-scale compute clusters and deep engineering support, you will formulate first-principles hypotheses and run large-scale empirical experiments. You will collaborate closely with world-class research and engineering peers to push the boundary of visual intelligence and translate core research breakthroughs directly into state-of-the-art foundation models and real-world capabilities.

What you will do
  • Frontier Research: Drive novel research at the intersection of foundation models, multimodal understanding, complex visual reasoning, and spatial intelligence.

  • Architecture & Training Innovations: Conceive and build novel model architectures, pre-training methodologies, and scalable post-training techniques (e.g., preference tuning, reasoning-focused RL) to systematically advance model capabilities.

  • Large-Scale Experimentation: Design, execute, and analyze large-scale distributed training experiments on modern accelerator clusters to push the frontier of model performance.

  • Data-Centric Intelligence: Pioneer innovative approaches to multimodal data curation, synthetic data generation, automated filtering, and rigorous benchmark evaluation.

  • Breakthrough to Capability: Collaborate with cross-functional research and systems engineering teams to turn fundamental algorithmic breakthroughs into robust, scalable foundation model capabilities deployed at scale.

What we are looking for
  • Ph.D. or equivalent industry research track record in Machine Learning, Computer Vision, Natural Language Processing, or a related quantitative discipline.

  • Rigorous foundational understanding of deep learning principles, transformer/multimodal architectures, and modern large-scale training dynamics.

  • Deep proficiency in Python and modern deep learning frameworks (PyTorch or JAX).

  • Demonstrated ability to independently define research agendas, design rigorous empirical experiments, and solve open-ended, frontier-level problems.

Nice to have
  • Specialized Domain Expertise: Deep theoretical and practical expertise in at least one of the following: foundation models, multimodal reasoning, visual/spatial intelligence, reinforcement learning, or post-training

  • Proven Research Impact: Strong track record demonstrated through first-author publications at top-tier venues (e.g. NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or key technical contributions to high-profile foundation model releases.

  • Distributed Systems & Scale: Hands-on experience training, profiling, and scaling models across large distributed GPU or TPU clusters (e.g., FSDP, Megatron-LM, DeepSpeed, Ray).

  • Data & Evaluation: Demonstrated experience developing large-scale multimodal data pipelines, synthetic reasoning trace generation, or designing rigorous evaluation suites for frontier models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist – Multimodal Foundation Models & Visual Reasoning
Research Scientist – Multimodal Foundation Models & Visual Reasoning

Elorian • Palo Alto (CA)

On-site
USD 180,000 - 300,000
Research Engineer – Robotics & Embodied AI
Research Engineer – Robotics & Embodied AI

Elorian • Iowa

On-site
USD 120,000 - 210,000
Research Engineer – Robotics & Embodied AI
Research Engineer – Robotics & Embodied AI

Elorian • Palo Alto (CA)

On-site
USD 150,000 - 230,000
Software Engineer - Core Platform
Software Engineer - Core Platform

Core Platform @ Elorian • Palo Alto (CA)

On-site
USD 250,000 - 450,000
Research Scientist - Multimodal Foundation Models
Research Scientist - Multimodal Foundation Models

Kindredventures • San Francisco (CA)

On-site
USD 180,000 - 300,000
Research Scientist – Multimodal Foundation Models
Research Scientist – Multimodal Foundation Models

Mecka • San Francisco (CA)

On-site
USD 185,000 - 210,000
Software Engineer - Applications
Software Engineer - Applications

Digitailor • Palo Alto (CA)

On-site
USD 250,000 - 400,000
Significant equity
Health insurance
Perks
Software Engineer - Core Platform
Software Engineer - Core Platform

Elorian • Palo Alto (CA)

Hybrid
USD 300,000 - 450,000
Equity stake
Full health benefits
Hybrid work (3 days in-office)
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →

Mecka • New York (NY)

On-site
USD 140,000 - 230,000
AI Researcher
AI Researcher

Pivots Hiring • San Mateo (CA)

On-site
USD 180,000 - 240,000