Research Scientist - Vision Data Infrastructure

Storm3

San Francisco (CA)

On-site

USD 250,000 - 600,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, Dental and Vision Insurance
Highly competitive salary package

Job summary

A leading AI research institution is seeking a Research Scientist specializing in Vision Data Infrastructure. This role focuses on building scalable pipelines for image and video datasets, ensuring ethical data collection, and leveraging simulation tools for synthetic data generation. Ideal candidates will have strong experience in data engineering and computer vision. A competitive salary package and excellent benefits are offered.

Qualifications

  • Strong experience with data engineering, computer vision, or machine learning infrastructure.
  • Expertise in building and scaling ETL/data pipelines for large unstructured datasets.
  • Proficiency with Python, PyTorch, and distributed data frameworks.

Responsibilities

  • Collect and organize image and video data from open datasets and the web.
  • Build high-throughput pipelines for vision data preprocessing.
  • Use simulation tools to generate high-quality synthetic vision data.

Skills

Data engineering expertise
Computer vision knowledge
Machine learning infrastructure
Python proficiency
PyTorch experience
Familiarity with distributed data frameworks

Tools

WebDataset
TFRecords
Parquet
Unreal Engine
Isaac Sim
Unity

Job description

Research Scientist - Vision Data Infrastructure

This role is offered by Storm3. Your actual pay will be based on your skills and experience — talk with your recruiter for details.

Base pay range $250,000 – $600,000 per year.

⚡ Research Scientists/Engineers (all levels)

🔍 Focus on Vision Data Infrastructure

Come join one of the only research institutions globally providing the resources to compete with top AI companies — tens of thousands of GPUs to explore state‑of‑the‑art research in LLMs, multimodal and agentic AI.

We are seeking AI talent with expertise in building scalable pipelines for vision data to support image/video generative training and multimodal alignment. You’ll design high-performance pipelines for large-scale image and video datasets, enabling efficient pretraining, alignment, and simulation-based data generation.

Responsibilities:

  • Vision Data Sourcing & Curation
    • Collect and organize image and video data from open datasets and the web.
    • Handle data cleaning, filtering, deduplication, and metadata generation.
    • Ensure ethical and compliant data collection at scale.
  • Processing & Augmentation
    • Build high-throughput pipelines for vision data preprocessing (frame extraction, resolution normalization, format conversion, latent caching).
    • Implement GPU-accelerated augmentation and distributed data loading (WebDataset, TFRecords, Parquet).
  • Synthetic & Simulation‑Based Data Generation
    • Use simulation tools (Unreal Engine 5, Isaac Sim, Unity) to generate high-quality synthetic vision data.
    • Create specialized datasets for VLM training, visual reasoning, and agent interaction.

Requirements:

  • Strong experience with data engineering, computer vision, or machine learning infrastructure.
  • Expertise in building and scaling ETL/data pipelines for large unstructured datasets.
  • Proficiency with Python, PyTorch, and distributed data frameworks (Ray, Spark, Dask).
  • Experience with WebDataset, TFRecords, Parquet, or similar high-throughput data formats.
  • Familiarity with GPU‑accelerated preprocessing, NVIDIA DALI, or equivalent systems.
  • Understanding of image/video codecs, data compression, and cloud storage optimization.

Preferred Experience:

  • Prior work with simulation-based or synthetic data generation using Unreal Engine, Isaac Sim, or Unity.
  • Experience curating datasets for multimodal or vision‑language model training.
  • Knowledge of data ethics, privacy, and compliance frameworks for large-scale AI datasets.
  • Experience contributing to open datasets or data-centric AI research.

Why apply:

  • Opportunity to join a fast-growing core team that is already pushing AI breakthroughs.
  • Highly competitive salary package.
  • Work alongside ambitious and bright superstars from tech and academia.
  • Medical, Dental and Vision Insurance.

Interested? Please contact stefani.lukic@storm3.com.

Seniority level: Mid‑Senior level

Employment type: Full‑time

Job function: Research and Engineering

Industries: Software Development and Research Services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist – World Modeling, Data
Research Scientist – World Modeling, Data

Institute of Foundation Models • Sunnyvale (CA)

On-site
USD 150,000 - 400,000
Medical benefits
Dental/vision
401K
+5
Senior Vision Language Model Engineer
Senior Vision Language Model Engineer

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Comprehensive benefits
Research Engineer in Data
Research Engineer in Data

Synthesia • United States

Hybrid
USD 130,000 - 190,000
Stock options
Hybrid work setting
25 days annual leave
Head of Research (AI / ML) [32814]
Head of Research (AI / ML) [32814]

Stealth AI Startup • San Francisco (CA)

On-site
USD 360,000 - 440,000
Competitive salary up to $400,000
Access to significant compute resources
Collaboration with elite engineers and researchers
Senior Vision Language Model Engineer
Senior Vision Language Model Engineer

Unknown • Myrtle Point (OR)

On-site
USD 184,000 - 357,000
Equity
Benefits
Research Engineer
Research Engineer

Orbifold AI • Los Altos (CA)

On-site
USD 120,000 - 250,000
Flexible work culture
Collaboration with AI leaders from major tech companies
Senior Field Data Scientist
Senior Field Data Scientist

The Lanes Group • San Francisco (CA)

On-site
USD 110,000 - 170,000
Competitive salary
Strong equity upside
Visa sponsorship available
Computer Vision Research Engineer
Computer Vision Research Engineer

Acceler8 • San Francisco (CA)

On-site
USD 180,000 - 250,000
Research Engineer, Visual Knowledge Work
Research Engineer, Visual Knowledge Work

Anthropic Limited • San Francisco (CA)

Hybrid
USD 350,000 - 850,000
Research Engineer, Multimodal Data
Research Engineer, Multimodal Data

Eventual • San Francisco (CA)

On-site
USD 120,000 - 150,000
Catered lunches and dinners
Commuter benefit
Health, vision, and dental coverage
+2