Generative Video ML Engineer — Low-Latency Production

AI Chopping Block; New York (NY); On-site; USD 140,000 - 220,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401K match

Commuter benefits

Lunch program

Dinner stipend

Grubhub

Wellness perks

Team offsites

Generous PTO

Job summary

Mirage is seeking an ML Engineer to build and scale the systems powering our video generation models. You’ll work on novel modeling approaches, training objectives, scaling strategies, and inference optimization to bring cutting-edge models into production.

This role sits at the intersection of research and systems engineering, focusing on making advanced models faster, more efficient, and capable of ultra-low latency, real-time generation.

Qualifications

• BS/MS/PhD in CS, ML, or related field.
• 2+ years of professional industry experience.
• Strong experience in deep learning systems and infrastructure.
• Expertise in PyTorch, CUDA, Triton, and distributed training (FSDP, etc.).
• Experience scaling and optimizing large models under low-latency inference constraints.
• Strong debugging and performance profiling skills.
• Ability to move quickly from prototype to production.

Responsibilities

• Train and optimize large-scale video and multimodal models.
• Improve efficiency across training and inference (memory, latency, cost).
• Implement techniques such as distillation, quantization, and pruning to aggressively accelerate diffusion and autoregressive generation.
• Build and maintain distributed training systems.
• Optimize GPU utilization, parallelism, and throughput.
• Develop tooling for experimentation, evaluation, and debugging.
• Translate research models into robust, production-ready systems.
• Monitor and improve model performance in real-world usage.

Skills

Deep learning systems

Infrastructure

PyTorch

CUDA

Triton

Distributed training

Low-latency inference

Prototype to production

Education

BS/MS/PhD in CS/ML or related field

Tools

GPU clusters

Profiling tools

Job description

Mirage is seeking an ML Engineer to build and scale the systems powering our video generation models. You’ll work on novel modeling approaches, training objectives, scaling strategies, and inference optimization to bring cutting-edge models into production.

This role sits at the intersection of research and systems engineering, focusing on making advanced models faster, more efficient, and capable of ultra-low latency, real-time generation.