Eval Researcher

Acceler8 Talent; San Francisco (CA); Ibrido; USD 120.000 - 180.000; Tempo pieno

Descrizione del lavoro

Acceler8 Talent is hiring an Evaluation Researcher for a frontier AI startup in San Francisco, onsite. You will help define, measure and improve what makes AI systems intelligent, reliable and engaging.

You’ll develop evaluation frameworks for real-time, multimodal AI systems, designing benchmarks and testing methodologies that assess speech, reasoning, interaction and conversational behaviour.

Competenze

• Strong ML research and engineering fundamentals.
• Experience with LLM evaluations, benchmarking or model assessment.
• Strong Python and deep learning experience.
• Familiarity with multimodal models, speech AI or conversational agents.
• Ability to design experiments and translate findings into improvements.

Mansioni

• Develop evaluation frameworks for real-time, multimodal AI systems.
• Design benchmarks and testing methodologies to measure model performance across speech, reasoning, interaction and conversational behaviour.

Conoscenze

ML research

Python

Deep learning

LLM evaluations

Multimodal models

Experiment design

Descrizione del lavoro

San Francisco — Onsite

I'm hiring anEvaluation Researcherfor a well-funded frontier AI startup building at the intersection ofmultimodal AI, real-time voice systems and intelligent agents.

The team is developing next-generationAI companionscapable of understanding live environments, holding natural conversations, managing interruptions and interacting with users in real time.

They're looking for someone to help define, measure and improve what makes these AI systems genuinely intelligent, reliable and engaging.

The Role

You'll work on the research and development ofevaluation frameworks for real-time, multimodal AI systems, designing benchmarks and testing methodologies that measure model performance across speech, reasoning, interaction and conversational behaviour.

Looking for:

• StrongML research and engineeringfundamentals.
• Experience withLLM evaluations, benchmarking or model assessment.
• StrongPython and deep learningexperience.
• Familiarity withmultimodal models, speech AI or conversational agents.
• Ability to design experiments, analyse model behaviour and translate findings into improvements.

Backed byleading venture capital investors and prominent startup accelerators, this is an opportunity to join an early-stage research team and help shape how next-generation AI systems are evaluated.

If you're interested in working at the forefront of LLM evaluations, multimodal AI and real-time intelligent systems