Staff Research Engineer — Open Models & Data Quality

Reflection AI; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Top-tier compensation

Stock options

Health & wellness

Meals in office

Parental leave

Unlimited PTO

Visa sponsorship

Team events

Job summary

Reflection is a research lab focused on open, accessible intelligence. The role centers on designing data sourcing, curation, and filtering for large-scale models, with emphasis on data quality, safety, and licensing.

You will collaborate with pre-training teams to scale systems and share insights with the open AI community. The ideal candidate has strong Python skills, experience with PyTorch or JAX, and a PhD or equivalent research background in CS/ML.

Qualifications

• Proficiency in Python and at least one deep learning framework (PyTorch or JAX).
• Experience debugging distributed workloads and writing scalable code.
• Strong written communication and ability to explain complex ideas.

Responsibilities

• Design and implement techniques for sourcing, curating, and filtering large-scale web, text, and code data.
• Develop data quality metrics and analyses for coverage, diversity, and representativeness.
• Join the pre-training research team to design and run data experiments with scalable data systems.
• Investigate and mitigate data risks including privacy, safety, and licensing concerns.
• Evaluate dataset changes through ablations and scaling experiments and assess downstream effects.
• Publish and present research, share code, datasets, and insights with the open AI community.

Skills

Python

Distributed workloads debugging

Code that scales

Education

Bachelor's degree in Computer Science, ML, Physics, or Mathematics

PhD in CS/ML/Physics/Math or equivalent industry research

Tools

PyTorch

JAX

Job description

Reflection is a research lab focused on open, accessible intelligence. The role centers on designing data sourcing, curation, and filtering for large-scale models, with emphasis on data quality, safety, and licensing.

You will collaborate with pre-training teams to scale systems and share insights with the open AI community. The ideal candidate has strong Python skills, experience with PyTorch or JAX, and a PhD or equivalent research background in CS/ML.