Edge AI Scientist — Multimodal Evaluation for Devices

Amazon; Cambridge; On-site; GBP 90,000 - 140,000; Full time

Job summary

Amazon Devices is an inventive research and development company that designs and engineers high-profile devices like Echo, Fire tablets, Fire TV, and other consumer devices. We are seeking exceptional scientists to join our Applied Science team to advance multimodal language models across our product portfolio.

The Silicon and Solutions Group Edge AI team seeks an Applied Scientist to develop evaluation methods for multimodal models and agents for our devices, including audio and vision

Qualifications

• PhD, or a Master’s degree and experience in CS, CE, ML or related field.
• Experience programming in Java, C++, Python or related language.
• Experience in patents or publications at top-tier peer-reviewed conferences or journals.
• Experience in algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing.
• Experience in building machine learning models for business application.

Responsibilities

• Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices, including audio, images, and videos
• Invent and validate reliability for novel automated evaluation methods for perception tasks, such as fine-tuned LLM-as-judge
• Develop and extend our evaluation framework(s) to support expanding capabilities for multimodal language models
• Analyze large offline and online datasets to understand model gaps, develop methods to interpret model failures, and collaborate with training teams to enhance model capabilities for product use cases
• Work closely with other scientists, compiler engineers, data collection, and product teams to advance evaluation methods

Education

PhD, or a Master’s degree and experience in CS, CE, ML or related field

Tools

Java

C++

Python

Algorithms & data structures

Numerical optimization

Data mining

Parallel & distributed computing

High‑performance computing

Job description

Amazon Devices is an inventive research and development company that designs and engineers high-profile devices like Echo, Fire tablets, Fire TV, and other consumer devices. We are seeking exceptional scientists to join our Applied Science team to advance multimodal language models across our product portfolio.

The Silicon and Solutions Group Edge AI team seeks an Applied Scientist to develop evaluation methods for multimodal models and agents for our devices, including audio and vision