Video Understanding & Segmentation ML Engineer

Glint Tech Solutions; Santa Clara (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Glint Tech Solutions in Santa Clara, CA seeks a highly skilled Machine Learning Engineer to advance video understanding and segmentation. You will build scalable systems that convert raw egocentric and human-robot video into structured, searchable data across embedding, captioning, retrieval, and LLM reasoning stages.

The role emphasizes multi-modal learning, large-scale video pipelines, and agentic orchestration, with collaboration across teams to drive production-ready capabilities.

Qualifications

• MS or PhD in CS/EE or related field, or equivalent practical experience.
• 3+ years of hands-on experience in computer vision or multi-modal machine learning.
• Strong proficiency in Python and PyTorch with solid software engineering fundamentals.
• Hands-on experience with CLIP or similar vision-language/video embedding models for retrieval or representation learning.
• Experience building or fine-tuning LLM-based systems for video/image understanding (captioning, video QA, summarization).
• Familiarity with agentic system design—tool use, multi-step reasoning, and orchestration frameworks.
• Experience with large-scale video data pipelines and vector search/retrieval infrastructure (FAISS, Milvus).

Responsibilities

• Build and optimize video/image embedding pipelines for large-scale video search and retrieval.
• Develop LLM-based video understanding systems for indexing, summarization, and QA over long-form video.
• Design segmentation algorithms to decompose long videos into structured clips.
• Build automated captioning systems combining vision-language models and LLMs.
• Architect agentic pipelines chaining embedding, captioning, retrieval, and LLM reasoning steps.
• Develop and scale video search infrastructure (vector indexing, retrieval, ranking) for multi-modal queries.
• Collaborate with annotation, data engineering, and robotics teams to integrate outputs into training pipelines.
• Evaluate and benchmark embedding models, LLMs, and agentic frameworks; track frontier research.

Skills

Python

PyTorch

Computer vision

Multimodal ML

Video understanding

Vector search

LangChain

LLM integration

Education

MS or PhD in CS/EE or related

Tools

FAISS

Milvus

Job description

Glint Tech Solutions in Santa Clara, CA seeks a highly skilled Machine Learning Engineer to advance video understanding and segmentation. You will build scalable systems that convert raw egocentric and human-robot video into structured, searchable data across embedding, captioning, retrieval, and LLM reasoning stages.

The role emphasizes multi-modal learning, large-scale video pipelines, and agentic orchestration, with collaboration across teams to drive production-ready capabilities.