Senior ML Researcher - LLM Post-Training & Efficiency

SOLANA FOUNDATION; San Francisco (CA); Hybrid; USD 250,000 - 350,000; Full time

Benefits offered by this job

Equity in a high-growth startup

Comprehensive benefits

Job summary

SOLANA FOUNDATION is seeking a skilled AI model trainer to push the boundaries of custom AI research. The role involves conducting research and training AI models, focusing on post-training optimization. You will work in a collaborative team environment in San Francisco.

The ideal candidate has over 3 years of experience in using PyTorch and a deep understanding of transformer architectures. A competitive salary and equity in a high-growth startup are included.

Qualifications

• 3+ years of experience training AI models using PyTorch.
• Deep understanding of transformer architectures and model internals.
• Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or alignment techniques.

Responsibilities

• Research and experiment with new model architectures.
• Explore methods to decrease inference latency.
• Train models for clients and run evaluations.

Skills

PyTorch

Transformer architectures

Attention mechanisms

SFT

RLHF

DPO

Experimental methodology

NVIDIA GPUs

Tools

Hugging Face Transformers

DeepSpeed

Megatron

TRL

Job description

SOLANA FOUNDATION is seeking a skilled AI model trainer to push the boundaries of custom AI research. The role involves conducting research and training AI models, focusing on post-training optimization. You will work in a collaborative team environment in San Francisco.

The ideal candidate has over 3 years of experience in using PyTorch and a deep understanding of transformer architectures. A competitive salary and equity in a high-growth startup are included.