ML Safety & Benchmarking Research Engineer
Apple Inc.
14 days+
Application generator
A complete application in a minute — tailored resume and cover letter, ready to send.
Get past ATS filters
Benefits offered by this job
Job summary
A leading technology company located in San Francisco is seeking a Machine Learning Research Engineer to design and develop safe AI benchmarking methodologies. This role involves collaboration with various teams to implement responsible evaluation techniques. Candidates should possess a strong research background, proficiency in Python, and experience in AI/ML model evaluation. The position offers competitive compensation, stock option opportunities, and comprehensive benefits including medical, dental coverage, and educational reimbursement.
Qualifications
- 1+ years of work experience either as a postdoc or in the industry.
- Experience working with or evaluating AI/ML models, preferably LLMs.
- Ability to interpret unstructured data and derive insights.
Responsibilities
- Design benchmarking methodologies across multiple media and applications.
- Develop automated evaluation pipelines for model outputs.
- Work closely with engineering teams to translate findings into model improvements.
Skills
Empirical evaluation
Experimental design
Benchmarking
Python proficiency
Analytical skills
Communication skills
Education
Advanced degree (MS or PhD) in Computer Science or related field
Tools
Python libraries (pandas, NumPy, PyTorch)
Annotation tools
Job description
A leading technology company located in San Francisco is seeking a Machine Learning Research Engineer to design and develop safe AI benchmarking methodologies. This role involves collaboration with various teams to implement responsible evaluation techniques. Candidates should possess a strong research background, proficiency in Python, and experience in AI/ML model evaluation. The position offers competitive compensation, stock option opportunities, and comprehensive benefits including medical, dental coverage, and educational reimbursement.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
