LLM Post-Training Scientist - SFT & RLHF

Scale AI, Inc.; San Francisco (CA); On-site; USD 181,000 - 226,000; Full time

Benefits offered by this job

Health benefits

Retirement plan

Learning stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. seeks Research Scientists and Research Engineers specializing in LLM post-training (SFT, RLHF, reward modeling) to optimize data curation and evaluation for enhancing LLMs in text and multimodal modalities.

You will develop novel methods to improve alignment and generalization of large-scale generative models and collaborate with researchers to define best practices in data-driven AI development.

Qualifications

• Ph.D. or Master’s in CS/ML/AI required.
• Deep understanding of deep learning, RL, and large-scale model fine-tuning.
• Experience with RLHF, preference modeling, or instruction tuning.
• Excellent written and verbal communication skills.

Responsibilities

• Research and develop post-training techniques to enhance LLMs.
• Design and experiment new approaches to preference optimization.
• Analyze model behavior and propose bias mitigation and robustness solutions.
• Publish research findings in top-tier AI conferences.

Skills

LLM post-training

Reinforcement learning

Data curation

Eval and bias mitigation

Scientific communication

Education

Ph.D. or Master’s in CS/ML/AI

Job description

Scale AI, Inc. seeks Research Scientists and Research Engineers specializing in LLM post-training (SFT, RLHF, reward modeling) to optimize data curation and evaluation for enhancing LLMs in text and multimodal modalities.

You will develop novel methods to improve alignment and generalization of large-scale generative models and collaborate with researchers to define best practices in data-driven AI development.