Member of Technical Staff, Multimodal Vision

Hark; San Jose (CA); On-site; USD 180,000 - 450,000; Full time

Job summary

Hark in San Jose, California is seeking a talented individual for the Omni team to develop the next generation of multimodal AI systems. This role involves research and development to advance capabilities in vision and video, including real-time user experiences across multiple modalities.

The ideal candidate has a strong track record in model advancements and data-driven methodologies, ready to collaborate closely with product teams to deliver innovative solutions.

Compensation ranges from $180,000 to $450,000 annually based on qualifications.

Qualifications

• Proven track record of advancing vision or video models.
• Strong experience in areas such as image understanding and generative vision.
• Experience with large-scale machine learning systems.

Responsibilities

• Drive research to advance vision and video capabilities in multimodal models.
• Develop large-scale vision and video data pipelines.
• Design state-of-the-art models for vision and video.
• Build evaluation frameworks for model performance.
• Collaborate with product teams on user-facing AI experiences.

Skills

Image understanding

Video modeling

Generative vision

Multimodal learning

Large-scale machine learning systems

Data-driven experimentation

Job description

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, and vision. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you will help drive the development of text, video, and multimodal models. This includes working across the full stack—from data and modeling to training, serving, and product integration. You will contribute to both pretraining and posttraining efforts while collaborating closely with product teams to push the boundaries of model capability and deliver exceptional end-to-end user experiences.

Responsibilities

• Drive research and development to advance vision and video capabilities in multimodal models, including image understanding, video modeling, and generative vision systems.
• Develop and improve large-scale vision and video data pipelines, including data collection, filtering, labeling, and synthetic data generation.
• Design and implement state-of-the‑art models for vision and video, including multimodal architectures that integrate vision with text and other modalities.
• Build evaluation frameworks and internal benchmarks to measure model performance, robustness, and visual quality across tasks.
• Optimize models and systems for scalability, efficiency, and real‑time or production deployment.
• Collaborate closely with product and engineering teams to translate research innovations into impactful, user‑facing AI experiences.

Requirements

• Proven track record of advancing vision or video models through innovations in data, modeling, or training.
• Strong experience in areas such as image understanding, video modeling, generative vision (e.g., diffusion, autoregressive models), or multimodal learning.
• Experience with large‑scale machine learning systems and distributed training.
• Strong background in data‑driven experimentation, evaluation, and iterative model development.
• Strong ownership mindset and ability to drive end‑to‑end impact from research to production.

Bonus Qualifications

• Background in graphics, rendering, simulation, or 3D vision is a plus.
• Experience with multimodal systems (vision + text, vision + audio) or real‑time AI systems is a strong plus.

Compensation

The US base salary range for this full‑time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job‑related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.