Member of Technical Staff, Multimodal Foundation Models

mecka

New York (NY)

On-site

USD 140,000 - 210,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mecka AI is seeking a research-oriented engineer to build vision-language and video models for annotation tasks from capture data, training and evaluating models at scale.

You will run large experiments on distributed GPU infrastructure, refine models with supervised fine-tuning, reinforcement learning, and produce production-ready pipelines for captioning and temporal grounding.

Qualifications

  • Hands-on experience with large multimodal models.
  • Strong deep learning fundamentals with PyTorch or JAX.
  • Experience running large experiments and drawing conclusions.
  • Familiarity with distributed training and GPU-based development.
  • Research instincts and engineering discipline.

Responsibilities

  • Build models that understand the footage.
  • Catch problems across what we collect.
  • Make models more reliable.
  • Turn video into useful annotations.
  • Take experiments through to production.

Skills

Multimodal models
Deep learning
Experiment design
Distributed training
Research mindset

Tools

PyTorch
JAX
GPU infrastructure

Job description

About Mecka AI

Mecka AI is building the data infrastructure layer for robotics and embodied AI.
We design and operate global systems for data capture, data labeling, and hardware-enabled workflows used by leading AI labs and robotics companies to train and validate humanoid and embodied AI systems.
We work closely with frontier robotics teams to bridge real-world data, simulation, learning-based systems, and deployed hardware.

The role

Every capture tells a story: what someone did, when they did it and whether they completed the task. At Mecka, you’ll build vision-language and video models that turn that footage into useful annotations and catch quality issues across more video than a human team could review.

You’ll own the work from data selection and training through evaluation and production. We’re looking for someone who brings strong research instincts and the engineering skills to make models reliable at scale—and who wants to understand where they fail as much as where they succeed.

What you’ll do
  • Build models that understand the footage. You’ll develop and improve vision-language and video models for egocentric and manipulation footage.

  • Catch problems across what we collect. You’ll build model pipelines that identify capture defects, missing coverage and task errors, then check their performance against human audits.

  • Make models more reliable. You’ll use supervised fine-tuning, preference optimization and reinforcement learning to improve reliability and reasoning.

  • Turn video into useful annotations. You’ll build pipelines for captioning, temporal grounding and video annotation at scale.

  • Take experiments through to production. You’ll run large experiments on distributed GPU infrastructure, analyze the results and turn successful approaches into production systems.

What you’ll bring
  • Hands-on experience with large multimodal models. You’ve trained, fine-tuned or post-trained vision-language or multimodal models.

  • Strong deep learning fundamentals. You’re comfortable building and training models with PyTorch or JAX.

  • Experience running large experiments. You can design an experiment, see it through and draw sound conclusions from the results.

  • Familiarity with distributed training. You know your way around GPU-based development and distributed training infrastructure.

  • Research instincts and engineering discipline. You ask good questions, test your assumptions and build clean systems that hold up beyond the experiment.

Nice to have

Experience in one or more of these areas would be valuable:

  • Footage quality control: Using vision-language and video models to identify defects and gaps in captured data.

  • Video understanding and annotation: Structured captioning, temporal grounding and scene understanding.

  • Training and post-training: Reward modeling, synthetic data, and data curation and filtering for multimodal models.

We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, we will partner with you to meet your needs.

We may use AI-assisted tools to help evaluate applications against the requirements of this role. These tools support our recruiting team in identifying qualified candidates but do not replace human judgment or limit which applications may be reviewed or considered.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist - Multimodal Foundation Models
Research Scientist - Multimodal Foundation Models

Kindredventures • San Francisco (CA)

On-site
USD 180,000 - 300,000
Member of Technical Staff, Computer Vision
Member of Technical Staff, Computer Vision

Mecka • New York (NY)

On-site
USD 98,000 - 140,000
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →
Research Scientist – Multimodal Foundation Models Toronto GTA · New York · San Francisco →

Mecka • New York (NY)

On-site
USD 140,000 - 230,000
Research Scientist – Multimodal Foundation Models
Research Scientist – Multimodal Foundation Models

Mecka • San Francisco (CA)

On-site
USD 185,000 - 210,000
Member of Technical Staff, Data Platform
Member of Technical Staff, Data Platform

Mecka • San Francisco (CA)

On-site
USD 98,000 - 140,000
Edge ML Engineer– Computer Vision
Edge ML Engineer– Computer Vision

Mecka • New York (NY)

On-site
USD 120,000 - 134,000
Member of Technical Staff, Evals & Data Quality
Member of Technical Staff, Evals & Data Quality

mecka • San Francisco (CA)

On-site
USD 140,000 - 190,000
Research Engineer, Simulation & World Models
Research Engineer, Simulation & World Models

Kindredventures • San Francisco (CA)

On-site
USD 150,000 - 230,000
Hardware, Edge ML Engineer
Hardware, Edge ML Engineer

Kindredventures • San Francisco (CA)

On-site
USD 140,000 - 210,000
Computer Vision Engineer, 3D
Computer Vision Engineer, 3D

Mecka • New York (NY)

On-site
USD 141,000 - 162,000