Research Scientist/Engineer — Controllable Video AI

lumalabs-ai; New York (NY); On-site; USD 200,000 - 450,000; Full time

Job summary

Luma seeks a fullstack researcher to refine and deploy foundation-model capabilities for creative workflows in New York. You will bridge research, product, and partnerships to ship expressive, controllable, and personalized model behaviors.

You’ll work across modeling, data, systems, and evaluation, using SFT, RL, distillation, and adapters to enable high-fidelity, partner-grade solutions while grounding data in real-world usage and feedback.

Qualifications

• Strong foundation in machine learning with visual generative models.
• Experience with fine-tuning, personalization, or data curation.
• Hands-on experience with PyTorch and large model training.

Responsibilities

• Develop controllability and features using SFT, RL, distillation, and adapters.
• Implement personalization with context management and PEFT.
• Define end-user quality metrics and evaluations.
• Collaborate with Product and Design to translate feedback into specs and ship models.

Skills

ML foundations

Visual generative models

Fine-tuning / personalization

Context management / PEFT

End-user research

Tools

PyTorch

Ray

Slurm

Kubernetes

Job description

Luma seeks a fullstack researcher to refine and deploy foundation-model capabilities for creative workflows in New York. You will bridge research, product, and partnerships to ship expressive, controllable, and personalized model behaviors.

You’ll work across modeling, data, systems, and evaluation, using SFT, RL, distillation, and adapters to enable high-fidelity, partner-grade solutions while grounding data in real-world usage and feedback.