Member of Technical Staff, Mid-training

Hark

San Jose (CA)

On-site

USD 180,000 - 450,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Hark is an AI company building multimodal models and next-generation AI hardware. The Omni team develops the multimodal foundation models, refining pretrained systems before post-training, with high-quality data mixtures, learning-rate schedules, and context extension to improve overall capabilities.

You will run experiments to assess checkpoint quality, compare model performance across text, code, and multimodal data, and collaborate with evaluation researchers to ensure robust results.

Qualifications

  • Experience with continued pretraining or late-stage training, including learning-rate decay and context extension.
  • Ability to build synthetic data pipelines with generation, verification and filtering.
  • Experience evaluating model quality and data diversity in controlled experiments.
  • Experience implementing and debugging distributed training workloads across GPU clusters.
  • Ability to design evaluations and identify confounds such as benchmark contamination or prompt sensitivity.
  • Strong engineering skills and a track record of improving model capabilities through research or production work.

Responsibilities

  • Develop mid-training recipes with high-quality and synthetic data and decay schedules.
  • Build synthetic data pipelines with checks for reasoning traces and data diversity.
  • Distill capabilities from larger models into smaller ones via synthetic data generation.
  • Create long-context data recipes and evaluate their impact on performance.
  • Evaluate mid-training checkpoints with the post-training team and select assets for further training.
  • Run controlled experiments on learning-rate schedules and data ordering across modalities.

Skills

Continued pretraining
Synthetic data pipelines
Distributed training
Model evaluation design
Experimental judgment
GPU clusters

Job description

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We’re pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today’s AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we’re developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you will build the multimodal foundation models at the core of this effort. You’ll develop the training stages that adapt pretrained models before post-training. This work includes high-quality and synthetic data mixtures, learning-rate schedules, context extension, and distillation. You’ll run experiments to improve model capabilities and work with evaluation and post-training researchers to assess checkpoint quality.

Responsibilities
  • Develop mid-training recipes using high-quality and synthetic data, including learning-rate decay schedules and data-mixture changes.
  • Build synthetic data pipelines with code execution tests, math-answer checks, and filters for reasoning traces.
  • Distill capabilities from larger models into smaller models through synthetic data generation and rejection sampling.
  • Develop long-context data recipes, including document packing and sequence construction, and evaluate their effect on both long- and short-context performance.
  • Evaluate mid-training checkpoints with the post-training team, measure how well results predict subsequent model quality, and select checkpoints for further training.
  • Run controlled experiments on learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.
Requirements
  • Experience with continued pretraining or late-stage training, such as learning-rate decay, high-quality data mixtures, or context extension.
  • Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality and data diversity.
  • Strong experimental judgment, including isolating recipe changes in controlled ablations and assessing whether improvements transfer to larger runs.
  • Experience implementing and debugging distributed training workloads across GPU clusters.
  • Experience designing evaluations and identifying confounds such as benchmark contamination, prompt sensitivity, and formatting effects.
  • Strong engineering skills, including implementing training methods and building reliable data and experimentation pipelines.
  • A record of improving model capabilities or training methods through research, datasets, systems, or production work.
Bonus Qualifications
  • Experience with distillation, rejection sampling, or model-based data generation for reasoning, code, or math.
  • Experience with long-context training, including rotary position embedding (RoPE) scaling, context parallelism, or long-document datasets.
  • Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.
  • Experience training or distilling smaller models for constrained inference budgets.
  • Experience with audio, speech, image, video, or interleaved multimodal datasets.
  • Experience detecting benchmark contamination and removing overlapping examples from training data.
Compensation

The US base salary range for this full-time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Mid-training San Jose
Member of Technical Staff, Mid-training San Jose

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Pretraining Architecture and Scaling
Member of Technical Staff, Pretraining Architecture and Scaling

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Pretraining
Member of Technical Staff, Pretraining

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Pretraining Evaluations San Jose
Member of Technical Staff, Pretraining Evaluations San Jose

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Multimodal
Member of Technical Staff, Multimodal

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Pretraining Architecture and Scaling San Jose
Member of Technical Staff, Pretraining Architecture and Scaling San Jose

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Pretraining Evaluations
Member of Technical Staff, Pretraining Evaluations

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Multimodal Speech
Member of Technical Staff, Multimodal Speech

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Multimodal Pretraining Data San Jose
Member of Technical Staff, Multimodal Pretraining Data San Jose

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Multimodal Vision
Member of Technical Staff, Multimodal Vision

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000