Member of Technical Staff, Mid-training San Jose

Hark; San Jose (CA); Presencial; USD 180.000 - 450.000; Jornada completa

Descripción de la vacante

Hark is an AI company building advanced, proactive, multimodal intelligence. The Omni team develops multimodal foundation models and long-context data recipes, exploring learning-rate schedules, data mixtures, and distillation to improve model capabilities.

The role focuses on mid-training recipes, synthetic data pipelines, evaluation, and distillation to transfer knowledge into smaller models, enabling efficient, recent AI systems across text, code, and multimodal data.

Formación

• Experience with continued pretraining or late-stage training including learning-rate decay.
• Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality.
• Strong experimental judgment and ability to isolate recipe changes in controlled ablations.
• Experience implementing and debugging distributed training workloads across GPU clusters.
• Experience designing evaluations and identifying confounds such as benchmark contamination and prompt sensitivity.
• Strong engineering skills and ability to build reliable data and experimentation pipelines.
• Evidence of improving model capabilities or training methods through research, datasets, systems, or production work.

Responsabilidades

• Develop mid-training recipes using high-quality and synthetic data, including learning-rate decay schedules and data-mixture changes.
• Build synthetic data pipelines with code execution tests, math-answer checks, and filters for reasoning traces.
• Distill capabilities from larger models into smaller models through synthetic data generation and rejection sampling.
• Develop long-context data recipes, including document packing and sequence construction, and evaluate their effect on both long- and short-context performance.
• Evaluate mid-training checkpoints with the post-training team, measure how well results predict subsequent model quality, and select checkpoints for further training.
• Run controlled experiments on learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.

Conocimientos

Continued pretraining

Synthetic data pipelines

Experimental design

Distributed training

Evaluation & ablations

Model evaluation

Engineering discipline

Multimodal expertise

Descripción del empleo

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you will build the multimodal foundation models at the core of this effort. You'll develop the training stages that adapt pretrained models before post-training. This work includes high-quality and synthetic data mixtures, learning-rate schedules, context extension, and distillation. You'll run experiments to improve model capabilities and work with evaluation and post-training researchers to assess checkpoint quality.

Responsibilities

• Develop mid-training recipes using high-quality and synthetic data, including learning-rate decay schedules and data-mixture changes.
• Build synthetic data pipelines with code execution tests, math-answer checks, and filters for reasoning traces.
• Distill capabilities from larger models into smaller models through synthetic data generation and rejection sampling.
• Develop long-context data recipes, including document packing and sequence construction, and evaluate their effect on both long- and short-context performance.
• Evaluate mid-training checkpoints with the post-training team, measure how well results predict subsequent model quality, and select checkpoints for further training.
• Run controlled experiments on learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.

Requirements

• Experience with continued pretraining or late-stage training, such as learning-rate decay, high-quality data mixtures, or context extension.
• Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality and data diversity.
• Strong experimental judgment, including isolating recipe changes in controlled ablations and assessing whether improvements transfer to larger runs.
• Experience implementing and debugging distributed training workloads across GPU clusters.
• Experience designing evaluations and identifying confounds such as benchmark contamination, prompt sensitivity, and formatting effects.
• Strong engineering skills, including implementing training methods and building reliable data and experimentation pipelines.
• A record of improving model capabilities or training methods through research, datasets, systems, or production work.

Bonus Qualifications

• Experience with distillation, rejection sampling, or model-based data generation for reasoning, code, or math.
• Experience with long-context training, including rotary position embedding (RoPE) scaling, context parallelism, or long-document datasets.
• Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.
• Experience training or distilling smaller models for constrained inference budgets.
• Experience with audio, speech, image, video, or interleaved multimodal datasets.
• Experience detecting benchmark contamination and removing overlapping examples from training data.

Compensation

The US base salary range for this full-time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.