PhD Thesis proposal in Digital SNN Accelerator for edge AI : Accelerated digital multilayer spi[...]

Université de Bordeaux - Laboratoire IMS; Castillon-la-Bataille; Sur place; EUR 40 000 - 60 000; Plein temps

Résumé du poste

A leading research institution in Nouvelle-Aquitaine is offering a PhD position focused on developing an accelerated digital neuromorphic spiking neural network using FPGA devices. The candidate will implement and optimize architectures and learning rules, contributing to innovative AI hardware solutions. The starting date is set for February 1. Public funding is available through the PEPR IA Emergence project.

Qualifications

• Experience with FPGA devices.
• Understanding of spiking neural networks.
• Knowledge of quantization and compression methods.

Responsabilités

• Develop an accelerated digital neuromorphic spiking neural network.
• Implement learning rules using FPGA devices.
• Optimize architecture and learning rules for performance.

Description du poste

Topic description

In recent years, artificial intelligence (AI) has become increasingly intertwined with our daily lives. However, AI such as that currently supported by most major players in the industry like GAFAM is decentralized to servers. Since the electricity consumption of Internet infrastructures represents about 5% of the world’s entire electricity production and because Internet traffic can be expected to triple every three years [1], we are in great need of alternative, energy-saving methods of calculation, so that the large-scale rise in AI does not lead to widespread disillusionment. In addition, embedded systems requiring AI are not necessarily permanently connected to the grid. The need to develop an energy-efficient hardware for the implantation of AI in nomadic systems is becoming increasingly urgent.

Major players in the industry like Qualcomm [2], Intel [3]and Google [4], Meta [5]have already proposed CMOS chips for the implementation of AI. However, these dedicated integrated circuits are currently limited to the implantation of continuous-valued neural networks (e.g. multi-layer formal neural networks). The development of a new hardware substrate must be accompanied by a more ambitious technological solution, e.g., event-based computing, which is particularly suitable for low-latency and low-power systems.

In this promising computational paradigm, information is created, processed or transmitted only when a change occurs either at the level of the sensor or the calculator. Such a system has thus extremely low power consumption if the activity is null. An illustration of this concept is the event-based camera developed by Prophesee [6]or Samsung [7]. Video streams in conventional systems are produced at about 25 frames per second. A processor then reduces the amount of information by eliminating redundant pixels from one image to another, i.e. if the pixel has not changed it is not stored after compression. Therefore, the scenario until now has been that redundant information is unnecessarily produced from the outset. On the other hand, the information created in event-based sensors is more meaningful from the very start. Similarly, in calculators based on spiking neural networks (SNNs), computation takes place only when an event occurs. Beyond reducing the amount of incoming data to process, event-based computing requires fewer operations per second during the inference phase compared to classical artificial neural networks [8]. Both characteristics –reduction of data and sparse computation – make event-based computing a promising framework for designing and building energy-efficient hardware for AI.

This computation paradigm is at the heart of innovative CMOS chips developed by IBM (TrueNorth [9]) or Intel (Loihi [10]). In Europe, several companies already use this principle of event-based calculus [5, 11-14]. The current stakeholders are involved either in neuromorphic sensors or in neuromorphic computing. However, the data processing depends on the nature of the input data. This PhD work will be a part of the Emergences project [15]that belongs to the PEPR AI funded by the French Research Agency (ANR).

The Emergences project aims at advancing the state-of-the art on near-physics emerging models by collaboratively exploring various computation models leveraging physical devices properties. This PhD work will focus on FPGA devices in order to build an accelerated spiking neural network capable of both inference and learning, aiming at investigating candidate architectures for ASIC design in a longer-term future beyond the scope of this PhD work.

Thesis objectives

As part of this PhD programme, the student will focus on developing an accelerated digital neuromorphic spiking neural network and its learning rules using FPGA devices.

They will first implement on FPGA spiking neural networks architectures and resource-efficient learning rules already existing in the literature to accelerate them. This study will focus on implementation cost and computational speed of both inference and learning.In a second phase, the student will optimise implemented architecture and learning rules previously studied by investigating quantization and compression methods. A common guideline for both parts will be to optimise both the implementation cost and the computational speed of the system while maintaining state-of-the-art performance.

1] [2]Zeroth Processor, Qualcomm, [3]Myriad IC, Intel Movidius [4] [5] [6] [7]IEEE ISSCC, [8]Neural Networks, [9] Science, [10]Intel, Loihi [11]IniVation [13]Brainchip [14]

Starting date

• 02-01

Funding category

Public funding alone (i.e. government, region, European, international organization research grant)

Funding further details

PEPR IA Emergence