Senior Member of Technical Staff, AI Benchmarking

Artificial Analysis, Inc.; San Francisco (CA); On-site; USD 100,000 - 150,000; Full time

Benefits offered by this job

Competitive compensation including equity

Opportunity to shape AI development

Job summary

Artificial Analysis, Inc. in San Francisco is hiring Members of Technical Staff to lead the design of evaluations that set standards in AI benchmarking. This position requires strong analytical skills and a genuine interest in AI technologies.

The role includes developing benchmarking methodologies, producing strategic reports, and collaborating with leading AI companies. Candidates should have proficiency in Python and an eagerness to become experts in frontier AI.

Compensation includes competitive pay and equity options in a rapidly growing team.

Qualifications

• Strong analytical and coding skills.
• Genuine, demonstrable interest and knowledge of frontier AI.
• Ability to code and follow AI model releases.

Responsibilities

• Design evaluations for AI systems and technologies.
• Drive the development of reports and data visualizations.
• Collaborate with leading AI companies to enhance benchmarking.

Skills

Analytical and critical thinking skills

Proficiency in Python

Interest in frontier AI

Job description

Artificial Analysis, Inc. in San Francisco is hiring Members of Technical Staff to lead the design of evaluations that set standards in AI benchmarking. This position requires strong analytical skills and a genuine interest in AI technologies.

The role includes developing benchmarking methodologies, producing strategic reports, and collaborating with leading AI companies. Candidates should have proficiency in Python and an eagerness to become experts in frontier AI.

Compensation includes competitive pay and equity options in a rapidly growing team.