Vision & Vision-Language Research Engineer - End-to-End ML

Zyphra; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Comprehensive medical, dental, vision

Competitive compensation

Relocation and immigration support

In-office snacks and meals provided

Unlimited PTO and holidays

In-person team in San Francisco

Job summary

Zyphra is seeking a Research Engineer - Vision & Vision-Language Models to join the Vision Team in San Francisco. You will work across the full model development stack, from data sourcing to pretraining, post-training, RL, and evaluation.

Experience with vision-language models is valuable but not required, and you will be evaluated on learning speed and execution. You will contribute to end-to-end training, model development, and dataset creation, collaborating with researchers and engineers

Qualifications

• Experience with vision-language or multimodal models is valuable.
• Strong ability to prototype ideas into experiments quickly.
• Excellent communication and collaboration in a fast-paced research setting.
• Experience with large-scale pretraining, post-training, or RL is a plus.

Responsibilities

• Lead end-to-end pretraining and post-training of vision-language models.
• Run large-scale vision and multimodal training experiments.
• Source, generate, curate, and evaluate vision datasets.
• Explore RL and other post-training methods for vision-language models.
• Contribute to architecture, data, and training methodology improvements.
• Collaborate across research and engineering to scale implementations.

Skills

PyTorch

Python

Multimodal models

Research prototyping

Experimentation

Communication

GPU clusters

Education

Postgraduate study in CS/ML

Tools

Web frameworks

Job description

Zyphra is seeking a Research Engineer - Vision & Vision-Language Models to join the Vision Team in San Francisco. You will work across the full model development stack, from data sourcing to pretraining, post-training, RL, and evaluation.

Experience with vision-language models is valuable but not required, and you will be evaluated on learning speed and execution. You will contribute to end-to-end training, model development, and dataset creation, collaborating with researchers and engineers