Media Benchmark Solutions Engineer — Equity

Artificial Analysis, Inc.; San Francisco (CA); On-site; USD 100,000 - 140,000; Full time

Benefits offered by this job

Competitive compensation including equity

Influence AI development

Work with leading AI labs

Job summary

Artificial Analysis, Inc. is seeking a Solutions Engineer in San Francisco to manage their media generation benchmarking pipeline.

You will run evaluations of image and video generation, manage studies, and ensure data quality. The ideal candidate has 3+ years in technical operations, is comfortable with Python, and possesses strong organizational skills.

Join a fast-growing team and influence AI development with competitive compensation, including equity.

Qualifications

• 3+ years of experience in a technical operations, data operations, or solutions engineering role.
• Comfortable with Python scripting and working with APIs.
• Good written and verbal English communication skills.
• Detail-oriented with strong process management skills.

Responsibilities

• Generate image and video outputs across models according to standardized evaluation protocols.
• Set up and manage human preference evaluation studies.
• Process and analyze preference vote data to produce benchmark results.
• Manage the end-to-end pipeline from prompt execution to published results.

Skills

Python scripting

Technical operations

Data analysis

Research study management

B2B SaaS

Job description

Artificial Analysis, Inc. is seeking a Solutions Engineer in San Francisco to manage their media generation benchmarking pipeline.

You will run evaluations of image and video generation, manage studies, and ensure data quality. The ideal candidate has 3+ years in technical operations, is comfortable with Python, and possesses strong organizational skills.

Join a fast-growing team and influence AI development with competitive compensation, including equity.