Senior ML Engineer: RL Environments for Frontier Models

Preference Model; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive cash and equity compensation

Health, vision, and dental benefits

401K match

Lunch provided everyday onsite

Visa sponsorship & relocation support

Job summary

Preference Model in San Francisco is seeking experienced Machine Learning Engineers to design and build reinforcement learning environments aimed at advancing model capabilities. The role blends research and engineering, requiring ownership of environment design and implementation.

Successful candidates will have strong ML fundamentals, proficiency in Python, and experience with either PyTorch or JAX. We offer competitive compensation, ownership in a fast-paced environment, and various employee benefits including health coverage and 401K matching.

Qualifications

• Creative in translating research into practical RLVR problems.
• Expert knowledge in deep learning or machine learning research.
• Experience with modern LLMs and inference libraries.

Responsibilities

• Design and build RL environments and reward functions.
• Collaborate with others to improve environment building processes.
• Conduct experiments and deliver production-ready environments.

Skills

Strong ML fundamentals

Proficiency in Python

Systems programming

Experience with PyTorch or JAX

Problem-solving skills

Current knowledge of ML infrastructure

Education

PhD or MS in relevant field

Tools

CUDA

Triton

Pallas

Job description

Preference Model in San Francisco is seeking experienced Machine Learning Engineers to design and build reinforcement learning environments aimed at advancing model capabilities. The role blends research and engineering, requiring ownership of environment design and implementation.

Successful candidates will have strong ML fundamentals, proficiency in Python, and experience with either PyTorch or JAX. We offer competitive compensation, ownership in a fast-paced environment, and various employee benefits including health coverage and 401K matching.