LLM Post-Training Researcher: Distillation & Efficiency

Inference; San Francisco (CA); Hybrid; USD 250,000 - 350,000; Full time

Benefits offered by this job

Competitive compensation

Equity in a high-growth startup

Comprehensive benefits

Job summary

A cutting-edge AI research startup in San Francisco is seeking a talented individual to conduct research and training on AI models. You will work on improving model quality and efficiency, while bringing innovative techniques into production. Candidates should have at least 3 years of experience in AI model training using PyTorch, strong knowledge of transformer architectures, and familiarity with various post-training techniques. This position offers competitive compensation between $250,000 - $350,000 plus equity and benefits.

Qualifications

• 3+ years of experience training AI models using PyTorch.
• Deep understanding of transformer architectures and attention mechanisms.
• Hands-on experience with post-training LLMs.

Responsibilities

• Research and experiment with new model architectures.
• Explore methods to decrease inference latency.
• Run experiments with new learning methods.

Skills

PyTorch

Transformer architectures

Attention mechanisms

Post-training techniques

Tools

Hugging Face Transformers

DeepSpeed

Megatron

Job description

A cutting-edge AI research startup in San Francisco is seeking a talented individual to conduct research and training on AI models. You will work on improving model quality and efficiency, while bringing innovative techniques into production. Candidates should have at least 3 years of experience in AI model training using PyTorch, strong knowledge of transformer architectures, and familiarity with various post-training techniques. This position offers competitive compensation between $250,000 - $350,000 plus equity and benefits.