Data Engineer – Multimodal Systems

Zyphra Technologies Inc.

San Francisco (CA)

On-site

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision plans
401(k) plan
Relocation and immigration support
In-office snacks and meals

Job summary

Zyphra Technologies Inc. is hiring a Data Engineer - Multimodal Systems in San Francisco. You will contribute to building, collecting, and refining Zyphra’s multimodal datasets and data pipelines, working across text, audio, and image modalities.

You will collaborate with teams across the company to collect large-scale data and implement highly parallel processing workflows. You will rapidly prototype ideas, run rigorous experiments, and ensure data quality.

Qualifications

  • Experience collecting, handling, and processing large datasets.
  • Experience with parallel Python programming frameworks such as Dask.
  • Understanding of the state-of-the-art in dataset curation across modalities.
  • Meticulous data quality checks and sanity testing.
  • Strong experimental methodology for ablations and hypothesis testing.
  • Understanding of large-scale, highly parallel data processing pipelines.
  • Proficiency with PyTorch and Python.
  • Experience contributing to large pre-existing codebases.
  • Previous machine learning research publications.

Responsibilities

  • Collect large-scale multimodal datasets (text, audio, image) and build robust data pipelines.
  • Design and optimize highly parallel data processing pipelines across modalities.
  • Run rigorous ablations to quantify data improvements and their impact.
  • Collaborate with researchers and engineers to accelerate data-driven experiments.

Skills

Python
PyTorch
Dask
Dataset curation
Experimentation
Communication

Education

Postgraduate degree in Computer Science / EE/EECS / Mathematics / Physics / Machine Learning

Tools

Git
Linux

Job description

The Role

As a Data Engineer - Multimodal Systems, you will be a core contributor to creating, collecting, and improving Zyphra’s datasets and data pipelines across a variety of modalities. Your work will intersect with almost every team at Zyphra. You will be involved in collecting large-scale datasets and implementing and optimizing highly parallel data pipelines.

You’ll Work Across
  • Large-scale data collection across a variety of modalities (text, audio, image)
  • Designing and working with highly efficient, parallelized data processing pipelines across modalities
  • Designing and running rigorous experimental ablations to demonstrate the impact of new data improvements
What We're Looking For / Requirements
  • Strong implementation and prototyping ability
  • Can take an idea from conception to experimentation quickly
  • The ability to work well with others in a high-paced research setting
  • Can rapidly learn new fields and are excited to implement new ideas
  • Excellent communication and collaboration skills, and can work effectively on both research and engineering implementation at scale.
Qualifications / Additional Skills
  • Experience collecting, handling, and processing large datasets
  • Experience with parallel Python programming frameworks such as Dask
  • Understanding of the state-of-the-art in dataset curation across modalities
  • A generally meticulous nature and a strong interest in actually looking at data and sanity checking things
  • Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing
  • Understanding of and interest in large-scale, highly parallel data processing pipelines.
  • Proficiency with PyTorch and Python.
  • Experience contributing to large pre-existing codebases and rapidly getting up to speed.
  • Previously published machine learning research in well-respected venues.
  • Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Mathematics, Physics, Machine Learning)
Why Work at Zyphra
  • Our research methodology is grounded in methodical, step-by-step approaches to ambitious goals. Both deep research and engineering excellence are equally valued
  • We strongly value new and crazy ideas and are very willing to bet big on new ideas
  • We move as quickly as we can; we aim to minimize the bar to impact as low as possible
  • We all enjoy what we do and love discussing AI
Benefits and Perks
  • Comprehensive medical, dental, vision, and FSA plans
  • Competitive compensation and 401(k) plan
  • Relocation and immigration support on a case-by-case basis
  • In-office snacks and meals provided
  • Unlimited PTO and company holidays
  • In-person team in San Francisco with a collaborative, high-energy environment
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Multimodal Systems
Data Engineer - Multimodal Systems

Bison • San Francisco (CA)

On-site
USD 150,000 - 230,000
Medical coverage
Dental coverage
Vision coverage
+8
Research Engineer - Vision and Vision-Language Models
Research Engineer - Vision and Vision-Language Models

Zyphra • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical benefits
Dental plan
Vision plan
+4
Research Engineer - Language Model Pre-Training
Research Engineer - Language Model Pre-Training

Bison • San Francisco (CA)

On-site
USD 190,000 - 240,000
Comprehensive medical, dental, vision,
FSA plans
Competitive compensation and 401(k)
+4
Research Engineer -- Vision and Vision-Language Models
Research Engineer -- Vision and Vision-Language Models

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation support
+3
Research Engineer – Language Model Pre-Training
Research Engineer – Language Model Pre-Training

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Comprehensive medical, dental, vision
Relocation support
In-office snacks and meals
+2
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3
Platform Engineer
Platform Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Research Engineer – Audio & Speech Models
Research Engineer – Audio & Speech Models

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
AI Engineer
AI Engineer

Bison • San Francisco (CA)

On-site
USD 180,000 - 240,000
Medical, dental, vision coverage
401(k) plan
Relocation support
+2
AI Engineer
AI Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision,
401(k) plan
Relocation and immigration support
+3