Researcher, Alignment Interpretability

Seoulstart; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

OpenAI is seeking a researcher focused on understanding deep networks, with strong engineering and quantitative reasoning skills, to develop and execute a plan in mechanistic interpretability. This role involves building infrastructure to study model internals at scale, publishing findings, and collaborating across teams to advance safe AGI initiatives.

The position emphasizes rigorous research processes and collaboration to influence future models while maintaining safety considerations in

Qualifications

• Develop and publish research on techniques for understanding representations of deep networks.
• Engineer infrastructure for studying model internals at scale.
• Collaborate across teams to work on projects that OpenAI is uniquely suited to pursue.

Responsibilities

• Develop and publish research on techniques for understanding representations of deep networks.
• Engineer infrastructure for studying model internals at scale.
• Collaborate across teams to work on projects that OpenAI is uniquely suited to pursue.

Job description

ABOUT THE TEAM The Interpretability team studies internal representations of deep learning models. We are interested in using representations to understand model behavior, and in engineering models to have more understandable representations. We are particularly interested in applying our understanding to ensure the alignment of powerful AI systems. Our working style is collaborative and curiosity-driven. ABOUT THE ROLE OpenAI is seeking a researcher passionate about understanding deep networks, with a strong background in engineering, quantitative reasoning, and the research process. You will develop and carry out a research plan in mechanistic interpretability, in close collaboration with a highly motivated team. You will play a critical role in helping OpenAI ensure future models remain safe even as they grow in capability. This will make a significant impact on our goal of building and deploying safe AGI. In this role, you will: - Develop and publish research on techniques for understanding representations of deep networks. - Engineer infrastructure for studying model internals at scale. - Collaborate across teams to work on projects that OpenAI is uniquely suited to pursue. -...