Member of Technical Staff, Pretraining

Hark; San Jose (CA); Vor Ort; USD 180.000 - 450.000; Vollzeit

Zusammenfassung

Hark, based in San Jose, California, is seeking a talented individual to join the Omni team focusing on large-scale pretraining systems and foundation models.

This role emphasizes innovation in multimodal AI experiences beyond text, with responsibilities including optimizing training infrastructures, collaborating across teams, and improving model performance through new data practices and evaluation frameworks.

The position offers a competitive salary in the range of $180,000 - $450,000 annually based on experience.

Qualifikationen

• Proven track record of enhancing neural network performance.
• Strong experience in large-scale distributed training.
• Deep understanding of LLM and multimodal pretraining.

Aufgaben

• Drive research in large-scale LLM and multimodal pretraining.
• Develop optimized data pipelines for pretraining.
• Design efficient training strategies for foundation models.

Kenntnisse

Large-scale neural network performance

Distributed training (Megatron, DeepSpeed)

Data-driven experimentation

High-performance computing systems

Jobbeschreibung

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We’re pairing that intelligence with next‑generation hardware to create a universal interface between humans and machines. While today’s AI largely operates through chat boxes and decade‑old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we’re developing multimodal models and next‑generation AI hardware together—designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and vision. Our goal is to create seamless, real‑time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you will focus on developing large‑scale pretraining systems and foundation models. This includes working across the full stack—from data curation and large‑scale training infrastructure to model architecture and optimization. You will play a key role in advancing the core capabilities of our models through pretraining at scale.

Responsibilities

• Drive research and development in large‑scale LLM and multimodal pretraining, focusing on improving model capability through better data, scaling, and architecture.


• Develop and optimize data pipelines for pretraining, including large‑scale data curation, filtering, deduplication, and synthetic data generation.


• Design and implement efficient training strategies for foundation models, including distributed training, scaling laws, and optimization techniques.


• Build and improve pretraining infrastructure, including training systems, data pipelines, and compute efficiency.


• Develop evaluation frameworks and internal benchmarks to measure pretraining progress and model capability.


• Collaborate with research and engineering teams to push the frontier of foundation model performance and scalability.

Requirements

• Proven track record of improving large‑scale neural network performance through advances in pretraining data, modeling, or training systems.


• Strong experience with large‑scale distributed training (e.g., Megatron, DeepSpeed, or similar frameworks).


• Deep understanding of LLM or multimodal pretraining, including data pipelines, scaling behavior, and optimization.


• Experience in data‑driven experimentation, systematic analysis, and debugging at scale.


• Experience building or working with large‑scale training infrastructure and high‑performance computing systems.


• Strong ownership mindset and ability to operate in fast‑paced, research‑driven environments.

Bonus Qualifications

• Experience with multimodal pretraining (text, audio, vision) is a strong plus.

Compensation

The US base salary range for this full‑time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job‑related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.