Research Scientist - Vision Data Infrastructure

Storm3

San Francisco (CA)

On-site

USD 250,000 - 600,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Medical, Dental and Vision Insurance
Highly competitive salary package

Job summary

A leading AI research institution is seeking a Research Scientist specializing in Vision Data Infrastructure. This role focuses on building scalable pipelines for image and video datasets, ensuring ethical data collection, and leveraging simulation tools for synthetic data generation. Ideal candidates will have strong experience in data engineering and computer vision. A competitive salary package and excellent benefits are offered.

Qualifications

  • Strong experience with data engineering, computer vision, or machine learning infrastructure.
  • Expertise in building and scaling ETL/data pipelines for large unstructured datasets.
  • Proficiency with Python, PyTorch, and distributed data frameworks.

Responsibilities

  • Collect and organize image and video data from open datasets and the web.
  • Build high-throughput pipelines for vision data preprocessing.
  • Use simulation tools to generate high-quality synthetic vision data.

Skills

Data engineering expertise
Computer vision knowledge
Machine learning infrastructure
Python proficiency
PyTorch experience
Familiarity with distributed data frameworks

Tools

WebDataset
TFRecords
Parquet
Unreal Engine
Isaac Sim
Unity

Job description

Research Scientist - Vision Data Infrastructure

This role is offered by Storm3. Your actual pay will be based on your skills and experience — talk with your recruiter for details.

Base pay range $250,000 – $600,000 per year.

⚡ Research Scientists/Engineers (all levels)

🔍 Focus on Vision Data Infrastructure

Come join one of the only research institutions globally providing the resources to compete with top AI companies — tens of thousands of GPUs to explore state‑of‑the‑art research in LLMs, multimodal and agentic AI.

We are seeking AI talent with expertise in building scalable pipelines for vision data to support image/video generative training and multimodal alignment. You’ll design high-performance pipelines for large-scale image and video datasets, enabling efficient pretraining, alignment, and simulation-based data generation.

Responsibilities:

  • Vision Data Sourcing & Curation
    • Collect and organize image and video data from open datasets and the web.
    • Handle data cleaning, filtering, deduplication, and metadata generation.
    • Ensure ethical and compliant data collection at scale.
  • Processing & Augmentation
    • Build high-throughput pipelines for vision data preprocessing (frame extraction, resolution normalization, format conversion, latent caching).
    • Implement GPU-accelerated augmentation and distributed data loading (WebDataset, TFRecords, Parquet).
  • Synthetic & Simulation‑Based Data Generation
    • Use simulation tools (Unreal Engine 5, Isaac Sim, Unity) to generate high-quality synthetic vision data.
    • Create specialized datasets for VLM training, visual reasoning, and agent interaction.

Requirements:

  • Strong experience with data engineering, computer vision, or machine learning infrastructure.
  • Expertise in building and scaling ETL/data pipelines for large unstructured datasets.
  • Proficiency with Python, PyTorch, and distributed data frameworks (Ray, Spark, Dask).
  • Experience with WebDataset, TFRecords, Parquet, or similar high-throughput data formats.
  • Familiarity with GPU‑accelerated preprocessing, NVIDIA DALI, or equivalent systems.
  • Understanding of image/video codecs, data compression, and cloud storage optimization.

Preferred Experience:

  • Prior work with simulation-based or synthetic data generation using Unreal Engine, Isaac Sim, or Unity.
  • Experience curating datasets for multimodal or vision‑language model training.
  • Knowledge of data ethics, privacy, and compliance frameworks for large-scale AI datasets.
  • Experience contributing to open datasets or data-centric AI research.

Why apply:

  • Opportunity to join a fast-growing core team that is already pushing AI breakthroughs.
  • Highly competitive salary package.
  • Work alongside ambitious and bright superstars from tech and academia.
  • Medical, Dental and Vision Insurance.

Interested? Please contact stefani.lukic@storm3.com.

Seniority level: Mid‑Senior level

Employment type: Full‑time

Job function: Research and Engineering

Industries: Software Development and Research Services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist – World Modeling, Data
Research Scientist – World Modeling, Data

Institute of Foundation Models • Sunnyvale (CA)

On-site
USD 150,000 - 400,000
Medical benefits
Dental/vision
401K
+5
Research Scientist - VLM
Research Scientist - VLM

Storm3 • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+1
Member of Technical Staff, Vision / Language
Member of Technical Staff, Vision / Language

xdof.ai • San Mateo (CA)

On-site
USD 120,000 - 160,000
Competitive compensation and equity
Comprehensive health and wellness benefits
Collaborative and fast-paced work environment
Research Scientist – AI
Research Scientist – AI

Bright Vision Technologies • Reston (VA)

On-site
USD 100,000 - 150,000
Research Engineer, Visual Knowledge Work
Research Engineer, Visual Knowledge Work

Anthropic • New York (NY)

Hybrid
USD 350,000 - 850,000
Generous vacation
Parental leave
Flexible working hours
Research Engineer
Research Engineer

Orbifold AI • Los Altos (CA)

On-site
USD 120,000 - 250,000
Flexible work culture
Collaboration with AI leaders from major tech companies
Senior Software Engineer, Metropolis Vision AI
Senior Software Engineer, Metropolis Vision AI

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 224,000 - 357,000
Equity
Benefits
Head of Research (AI / ML) [32814]
Head of Research (AI / ML) [32814]

Stealth AI Startup • San Francisco (CA)

On-site
USD 400,000
Competitive salary up to $400,000
Access to significant compute resources
Collaboration with elite engineers and researchers
Research Engineer - Vision Language Models / Multimodal AI / Computer Vision
Research Engineer - Vision Language Models / Multimodal AI / Computer Vision

Acceler8 Talent • Mountain View (CA)

Hybrid
USD 180,000 - 240,000
Senior Field Data Scientist
Senior Field Data Scientist

The Lanes Group • San Francisco (CA)

On-site
USD 110,000 - 170,000
Competitive salary
Strong equity upside
Visa sponsorship available