ML Engineer: Vision-Language & Motion for Autonomy

Praxis, Inc.; San Francisco (CA); On-site; USD 150,000 - 240,000; Full time

Job summary

NomadicML is seeking a Machine Learning Engineer to push the frontier of foundation-model research and production engineering. You will help define how machines learn from motion by training and fine-tuning large-scale Vision-Language Models on motion-rich video data.

You will build multi-modal architectures that perceive, localize, and describe motion events across millions of frames, turning breakthroughs into robust APIs and SDKs for enterprise customers.

Qualifications

• Strong proficiency in Python, PyTorch, and large-scale ML workflows.
• Research experience in foundation models, VLMs, or multi-modal learning (publications/patents a plus).
• Ability to iterate quickly and autonomously, running experiments end-to-end.
• Experience training or fine-tuning models on video or sensor data.
• Understanding of retrieval systems, embeddings, and GPU optimization.

Responsibilities

• Train and evaluate VLMs specialized for motion understanding in autonomous-driving and robotics datasets.
• Design and scale GPU-accelerated pipelines for training, fine-tuning, and inference on multi-modal data (video + language + sensor metadata).
• Build agentic evaluation frameworks that benchmark spatiotemporal reasoning, localization accuracy, and narrative consistency.
• Develop and productionize curation loops that use our own models to generate and refine datasets (“AI training AI”).
• Publish high-impact research while shipping features that customers use immediately.

Skills

Python

PyTorch

Foundation models

Vision-Language Models

Multi-modal learning

Experimentation

Tools

Hugging Face

DeepSpeed

Ray

Kubeflow

MLflow

Job description

NomadicML is seeking a Machine Learning Engineer to push the frontier of foundation-model research and production engineering. You will help define how machines learn from motion by training and fine-tuning large-scale Vision-Language Models on motion-rich video data.

You will build multi-modal architectures that perceive, localize, and describe motion events across millions of frames, turning breakthroughs into robust APIs and SDKs for enterprise customers.