Post-Training Research Scientist

Two Sigma

New York (NY)

Hybrid

USD 165,000 - 300,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical and dental insurance
401k match
Life & disability insurance
Hybrid in-office policy

Job summary

Two Sigma is hiring a Post-Training Research Scientist to build RLHF, DPO, and reward modeling capabilities from the ground up in a greenfield role based in New York, NY. You will define infrastructure, research agenda, and evaluation frameworks for aligning LLMs to complex multi-step workflows in quantitative finance.

You will own methodology across training, fine-tuning, context management, and model evaluation, shaping both post-training capabilities and broader research direction of the team.

Qualifications

  • BS or equivalent in Science, Technology, Engineering or Math (MS a plus).
  • Minimum 1 year experience; 1–10 years preferred at a frontier AI lab (OpenAI, Anthropic, DeepMind, Meta FAIR, or equivalent).
  • Shipped post-training systems in production: RLHF, DPO, RLAIF, or related methods.
  • Deep understanding of distributed training infrastructure: multi-node GPU clusters, training stability, checkpointing.
  • Track record managing large-scale compute: budgeting, experiment design, ablations.
  • Publications or demonstrated expertise in alignment, preference learning, or reward modeling.
  • Hands-on implementation skills: PyTorch/JAX, distributed frameworks (DeepSpeed, FSDP, etc.)

Responsibilities

  • Lead post-training efforts for LLMs applied to financial time series and quantitative reasoning.
  • Design and execute RLHF, DPO, and related alignment methods at scale, including deployment of substantial compute budgets (O($100mm)).
  • Build infrastructure for preference data collection, reward modeling, and policy optimization on financial datasets.
  • Drive research agenda connecting post-training methods to quantitative finance applications.
  • Collaborate with quant researchers to define task distributions and evaluation frameworks.
  • Unblock production systems dependent on post-training capabilities.

Skills

RLHF
DPO
Reward modeling
Distributed training infra
Budgeting compute
PyTorch/JAX
DeepSpeed / FSDP

Education

BS in STEM

Tools

PyTorch/JAX
DeepSpeed
FSDP

Job description

Position Summary Two Sigma is a leading quantitative investment management and trading firm. The company applies a scientific approach to investing, combining cutting-edge technology, artificial intelligence, data science, and quantitative research with rigorous human inquiry to capitalize on market opportunities and deliver alpha for investors.

Our team of engineers, quantitative researchers and data scientists looks beyond the traditional to test hypotheses and develop creative solutions to some of the world’s most complex economic problems. We are applying large language models and transformer-based architectures to problems where ground truth is delayed, noisy, and non-stationary. Our systems generate code, run experiments, and iterate autonomously, and we are looking to go beyond supervised fine-tuning.

We are hiring a Post-Training Research Scientist to build RLHF, DPO, and reward modeling capabilities from the ground up. This is a greenfield role: you will define the infrastructure, research agenda, and evaluation frameworks for aligning LLMs to sophisticated, multi-step workflows in a domain where the reward signal is fundamentally different from existing research on human preference or deterministic task completion.

This hire will help own methodology across training, fine-tuning, context management, and model evaluation. You will shape not only the post-training capability but the broader research direction of the team.

You will take on the following responsibilities:
  • Lead post-training efforts for LLMs applied to financial time series and quantitative reasoning
  • Design and execute RLHF, DPO, and related alignment methods at scale, including deployment of substantial compute budgets (O($100mm))
  • Build infrastructure for preference data collection, reward modeling, and policy optimization on financial datasets
  • Drive research agenda connecting post-training methods to quantitative finance applications
  • Collaborate with quant researchers to define task distributions and evaluation frameworks
  • Unblock production systems dependent on post-training capabilities
You should possess the following qualifications:
  • BS or equivalent work experience in Science, Technology, Engineering or Math (an MS is a plus).
  • Minimum 1 year of experience required; 1-10 years of experience preferred (ideally 1-5 years) at a frontier AI lab (OpenAI, Anthropic, DeepMind, Meta FAIR, or equivalent)
  • Shipped post-training systems in production: RLHF, DPO, RLAIF, or related methods
  • Deep understanding of distributed training infrastructure: multi-node GPU clusters, training stability, checkpointing
  • Track record managing large-scale compute: budgeting, experiment design, ablations
  • Publications or demonstrated expertise in alignment, preference learning, or reward modeling
  • Hands-on implementation skills: PyTorch/JAX, distributed frameworks (DeepSpeed, FSDP, etc.)
You will enjoy the following benefits:
  • Core Benefits: Fully paid medical and dental insurance premiums for employees and dependents, competitive 401k match, employer-paid life & disability insurance
  • Perks: Onsite gyms with laundry service, wellness activities, casual dress, snacks, game rooms
  • Learning: Tuition reimbursement, conference and training sponsorship
  • Time Off: Generous vacation and unlimited sick days, competitive paid caregiver leaves
  • Hybrid Work Policy: Flexible in-office days with budget for home office setup

The base pay for this role will be between $165,000 and $300,000. This role may also be eligible for other forms of compensation and benefits, such as a discretionary bonus, health, dental and other wellness plans and 401(k) contributions. Discretionary bonus can be a significant portion of total compensation. Actual compensation for successful candidates will be carefully determined based on a number of factors, including their skills, qualifications and experience.

We are proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Two Sigma is committed to providing reasonable accommodations to qualified individuals in accordance with applicable federal, state, and local laws.

If you believe you need an accommodation, please visit our website for additional information.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Research Scientist - Campus Full-Time
AI Research Scientist - Campus Full-Time

Two Sigma • New York (NY)

Hybrid
USD 200,000 - 220,000
Onsite gyms with laundry service
Wellness activities
Casual dress
+4
AI Research Scientist - Campus Full-Time
AI Research Scientist - Campus Full-Time

Two Sigma • New York (NY)

On-site
USD 270,000 - 330,000
Health insurance
401(k) match
Life & disability insurance
+4
Quantitative Researcher - Experienced Hire
Quantitative Researcher - Experienced Hire

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 325,000
Fully paid medical and dental insurance
Competitive 401k match
Onsite gyms with laundry service
+2
Quantitative Researcher: Machine Learning
Quantitative Researcher: Machine Learning

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 325,000
Medical & dental
401k match
Life & disability insurance
+4
Quantitative Software Engineer: Techniques Engineering
Quantitative Software Engineer: Techniques Engineering

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 300,000
Onsite gyms with laundry service
Tuition reimbursement
Generous vacation and unlimited sick days
Quantitative Researcher - Execution Modeling
Quantitative Researcher - Execution Modeling

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 300,000
Medical & dental insurance
401k match
Life & disability insurance
+1
Quantitative Software Engineer: Generative AI
Quantitative Software Engineer: Generative AI

Two Sigma • New York (NY)

On-site
USD 165,000 - 300,000
Medical insurance
Dental insurance
401k match
+15
Quantitative Researcher - Quantitative Macro & Fixed Income
Quantitative Researcher - Quantitative Macro & Fixed Income

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 300,000
Fully paid medical & dental insurance
401k match
Life & disability insurance
+11
Quantitative Software Engineer: Portfolio Research Acceleration
Quantitative Software Engineer: Portfolio Research Acceleration

Two Sigma • New York (NY)

Hybrid
USD 165,000 - 300,000
Medical and dental insurance
401k match
Life & disability insurance
+4
Quantitative Researcher - Full-Time Campus Hire
Quantitative Researcher - Full-Time Campus Hire

Two Sigma • New York (NY)

On-site
USD 270,000 - 330,000
Medical and dental insurance
401k match
Life & disability insurance
+4