Applied AI Research Staff Engineer - On-Site SF

Artificial Analysis, Inc.; San Francisco (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Artificial Analysis, Inc. in San Francisco is seeking a Member of Technical Staff (Applied AI Research). You will design novel frontier evaluations, build datasets and infrastructure, and evaluate every major model as it is released.

This applied research role directly influences how AI capabilities are measured and understood by labs, enterprises, and policymakers. You will publish influential analyses and collaborate with frontier labs on pre-release models, embracing an AI-native workflow to

Qualifications

• 3+ years of professional experience in AI or ML research or engineering.
• Strong analytical and coding skills.
• Proficiency in Python and data analysis.
• Genuine interest and knowledge of Frontier AI.

Responsibilities

• Design and ship frontier evaluation methodologies that advance how AI capabilities are measured.
• Build datasets, harnesses and scoring systems for our benchmarks.
• Evaluate every major model as they are released and own result integrity.
• Publish reports, indexes and data visualizations that shape industry understanding of AI progress.
• Collaborate with frontier labs on pre-release models and maintain an AI-native workflow.

Skills

Python

Data analysis

Analytical thinking

Job description

Artificial Analysis, Inc. in San Francisco is seeking a Member of Technical Staff (Applied AI Research). You will design novel frontier evaluations, build datasets and infrastructure, and evaluate every major model as it is released.

This applied research role directly influences how AI capabilities are measured and understood by labs, enterprises, and policymakers. You will publish influential analyses and collaborate with frontier labs on pre-release models, embracing an AI-native workflow to