Remote Iowa-based AI Model Benchmarking Intern

Braintrust; United States; Remote; USD 30,000 - 39,000; Part time

Job summary

SureHost, a Des Moines, Iowa-based hospitality tech company, seeks an AI Model Benchmarking Intern. This remote, Iowa-focused internship involves evaluating LLMs and VLMs, building benchmarks, and reporting findings to guide model choices and roadmap.

You will work closely with the AI Chief Architect, perform repeatable experiments, and document methods and results. This role offers real responsibility on a live product and mentorship on applied model evaluation.

Qualifications

• Interest in applied AI and familiarity with LLMs, VLMs, generative AI tools, or model APIs through coursework or projects.
• Logical, evidence-based thinking and comfort working with structured data and evaluation criteria.
• Basic Python or data-analysis skills.
• The ability to document methods and results clearly.
• Patience to run repeatable experiments, investigate edge cases, and separate a compelling demo from dependable performance.

Responsibilities

• Research and compare evolving LLM and VLM models that may support SureHost's product use cases.
• Create representative evaluation datasets, test cases, scoring criteria, and repeatable benchmark workflows.
• Measure model quality across accuracy, reliability, latency, cost, and other product-relevant factors.
• Analyze failure patterns and trade-offs, including false positives and false negatives on issues operators care about.
• Present clear findings and recommendations to inform model strategy and the product roadmap.
• Maintain benchmark results and documentation as models, APIs, and requirements change.

Skills

Applied AI

Python basics

Data analysis

Documentation

Tools

Python

Job description

SureHost, a Des Moines, Iowa-based hospitality tech company, seeks an AI Model Benchmarking Intern. This remote, Iowa-focused internship involves evaluating LLMs and VLMs, building benchmarks, and reporting findings to guide model choices and roadmap.

You will work closely with the AI Chief Architect, perform repeatable experiments, and document methods and results. This role offers real responsibility on a live product and mentorship on applied model evaluation.