LLM Post-Training Research Scientist (SFT & RLHF)

Scale AI, Inc.; New York (NY); On-site; USD 181,000 - 226,000; Full time

Benefits offered by this job

Health, dental & vision coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. is seeking Research Scientists and Research Engineers to advance LLM post-training techniques, including SFT, RLHF, and reward modeling, with a focus on data curation and evaluation to improve performance in text and multimodal modalities.

You will collaborate with researchers and engineers to define best practices in data-driven AI development and contribute to the next generation of generative models.

Qualifications

• Ph.D. or Master’s in Computer Science, Machine Learning, AI, or a related field.
• Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning.
• Experience with post-training techniques such as RLHF, preference modeling, or instruction tuning.
• Excellent written and verbal communication skills.

Responsibilities

• Research and develop novel post-training techniques to enhance LLM core capabilities in text and multimodal modalities.
• Design and experiment new approaches to preference optimization.
• Analyze model behavior, identify weaknesses, and propose solutions for bias mitigation and model robustness.
• Publish research findings in top-tier AI conferences.

Skills

SFT

RLHF

Reward modeling

Fine-tuning large models

Reinforcement learning

Multimodal data

Education

Ph.D./Master’s in CS/ML/AI

Job description

Scale AI, Inc. is seeking Research Scientists and Research Engineers to advance LLM post-training techniques, including SFT, RLHF, and reward modeling, with a focus on data curation and evaluation to improve performance in text and multimodal modalities.

You will collaborate with researchers and engineers to define best practices in data-driven AI development and contribute to the next generation of generative models.