Member of Technical Staff, RL Research & Environments

Magic; San Francisco (CA); Hybrid; USD 200,000 - 550,000; Full time

Benefits offered by this job

Equity

401(k) with 6% match

Health insurance

Dental and vision insurance

Unlimited PTO

Visa sponsorship and relocation stipen

Small, focused team

Job summary

Magic is seeking a Software Engineer for the RL Research & Environments team to design and operate data, evaluation, and environment systems that improve model capabilities after pre-training.

You will focus on post-training: identifying capability gaps, building targeted datasets, designing reward signals, and running iterative training loops that measurably improve user-facing behavior. The role emphasizes infrastructure and experimental workflows for scalable RL.

Qualifications

• Strong software engineering fundamentals.
• Experience building or operating large-scale data or ML systems.
• Ability to design and interpret experiments that measure model behavior changes.
• Comfort working at the intersection of ML, data systems, and infrastructure.
• Strong attention to data quality and evaluation rigor.
• Track record of owning experimental or production systems end-to-end.

Responsibilities

• Design and operate data, evaluation, and environment systems to improve model capabilities after pre-training.
• Identify capability gaps and build targeted datasets, reward signals, and training loops.
• Own infrastructure and workflows that connect product priorities to capability gains.
• Build systems to surface long-context failure modes and enable rapid RL iteration at scale.
• Collaborate with Product and Research to translate capability goals into measurable iterations.

Skills

Software engineering fundamentals

Large-scale ML/data systems

Experiment design & interpretation

Data quality & evaluation rigor

End-to-end prod systems

Job description

Member of Technical Staff, RL Research & Environments

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About the role

As a Software Engineer on the RL Research & Environments team, you will design and operate the data, evaluation, and environment systems that improve model capabilities after pre-training.

This role focuses on post-training: identifying capability gaps, building targeted datasets, designing reward signals, and running iterative training loops that measurably improve user-facing behavior. You will own the infrastructure and experimental workflows that connect product priorities to concrete capability gains.

Magic’s long-context models introduce distinct post-training challenges: long-horizon reasoning, sustained coherence over extended trajectories, context-use quality, and tool-augmented behavior. You will build systems that expose failure modes, generate high-signal training data, and enable rapid RL iteration at scale.

This role can evolve into ownership of major capability areas, deeper RL systems work, or broader influence over post-training strategy as Magic scales long-context model performance and reliability.

What you’ll work on

Design and build post-training datasets using synthetic generation, targeted data collection, and self-play

Implement filtering, scoring, and mixture strategies for RL and post-training corpora

Build and maintain evaluation frameworks that surface long-context failure modes

Design reward signals and training environments for targeted capability improvements

Run ablations across data sources, reward designs, and long-horizon task structures

Improve reliability and observability of post-training data and environment pipelines

Collaborate closely with Product and Research to translate capability goals into measurable iteration cycles

What we’re looking for

Strong software engineering fundamentals

Experience building or operating large-scale data or ML systems

Ability to design and interpret experiments that measure model behavior changes

Comfort working at the intersection of ML, data systems, and infrastructure

Strong attention to data quality and evaluation rigor

Track record of owning experimental or production systems end-to-end

Compensation, benefits, and perks (US):

Annual salary range:s between $200K - $550K based on experience

• Equity is a significant part of total compensation, in addition to salary
• 401(k) plan with 6% salary matching
• Generous health, dental and vision insurance for you and your dependents
• Unlimited paid time off
• Visa sponsorship and relocation stipend to bring you to SF, if possible
• A small, fast-paced, highly focused team

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.

Our culture

Integrity. Words and actions should be aligned

Hands-on. At Magic, everyone is building

Teamwork. We move as one team, not N individuals

Focus. Safely deploy AGI. Everything else is noise