[PhD] Deploying AI Workloads in Real-Time Systems

HiPEAC; Toulouse; On-site; EUR 30,000 - 36,000; Full time

Job summary

The CNRS invites applications for a 36-month PhD focused on deploying AI workloads in real-time systems, hosted by LAAS-CNRS in Toulouse, with collaboration across leading laboratories in France and Europe. The position targets candidates with a graduate degree in Computer Science or Mathematics and is available immediately.

The role is full-time and based in Toulouse, FR, with an emphasis on edge AI, real-time scheduling, and runtime-adaptive neural networks within a multi-institutional

Qualifications

• Candidates must hold a graduate degree (or equivalent) in Computer Science or Mathematics.

Responsibilities

• Design and conduct a research project on deploying AI workloads in real-time systems.
• Develop real-time scheduling frameworks for edge AI applications.
• Collaborate with LAAS-CNRS, LIRIS-CNRS, Inria Rennes and TUM to advance research objectives.
• Provide runtime-adaptive neural network approaches to meet timing and performance constraints.

Education

Graduate degree in Computer Science or Mathematics

Job description

Context

Deploying large AI models on edge devices presents several challenges due to inherent hardware constraints and the rapidly increasing size of AI models. Embedded platforms typically offer limited computational resources and storage capacity, with less flexibility than cloud computing infrastructures. In recent years, numerous hardware solutions specifically designed for edge AI have emerged. These domain-specific architectures exploit parallelism, optimize memory transfers, and support reduced-precision computation. At the software level, specialized techniques aim to reduce model size so that models can fit within the available on-chip memory by reducing the number of parameters and their bit-width representation, through approaches such as model compression, pruning, and quantization.

Real-time scheduling for AI workloads

Nonetheless, hardware acceleration and software optimization alone cannot guarantee real-time performance. Resource management and scheduling are required to decide, at each instant, which neural network should execute on which processing unit. Traditionally, these approaches focus primarily on meeting timing objectives, whereas edge AI requires consideration of several additional aspects: accuracy, energy consumption, and, when necessary, thermal constraints. Satisfying these constraints requires accurately characterizing the AI workload (i.e., the task model) in terms of its parallelism level, memory footprint, and precision. Consequently, scheduling policies should not only account for these additional constraints but also be designed with regard to the underlying hardware capabilities (e.g., large number of processing units, limited on-chip memory capacity, and high context-switching overhead).

Objectives

Real-time systems are composed of multiple tasks, each with specific timing constraints (e.g., deadlines and execution frequency), execution requirements, and criticality levels. In edge AI applications, each real-time task can run a neural network inference. The goal of this thesis is to propose a framework for integrating AI models into real-time and edge AI systems while meeting specific timing and performance constraints on modern AI hardware accelerators. To this end, the following objectives will be addressed:

• Design space exploration: Develop a toolbox to optimize the compression levels of neural networks under timing and performance constraints.
• Hardware resource partitioning and configuration: Determine the optimal partitioning of available hard-ware resources, find the best topologies of processing elements (e.g., pipeline depth), and assign schedulingparameters (e.g., priorities and preemption points).
• Real-time scheduling: Develop scheduling policies tailored to AI models and AI hardware accelerators.
• Runtime-adaptive neural networks: Develop neural network models with runtime control of their execution, enabling the workload to adapt to current system utilization, available parallelism, or energy constraints.

Research group

The project is a collaboration among the Laboratory for Analysis and Architecture of Systems (LAAS-CNRS), the Laboratory for Computer Science in Images and Information Systems (LIRIS-CNRS), Inria Center at Rennes University, and the Technical University of Munich (TUM). The host laboratory is the LAAS-CNRS in Toulouse, France. The thesis will co-supervised by Dr. Tomasz Kloda (LAAS-CNRS), Prof. Stefan Duffner(LIRIS-CNRS), Prof. Angeliki Kritikakou (Inria Rennes) and Dr. Binqi Sun (TUM).

Qualifications

Candidates must hold a graduate degree (or equivalent) in Computer Science or Mathematics.

Duration

36 months. The position is available immediately.

The Centre National de la Recherche Scientifique (CNRS) is a public research organization in France, fostering interdisciplinary collaboration to address social and economic challenges through innovative research.

[PhD] Deploying AI Workloads in Real-Time Systems

Full-time

CNRS - The French National Centre for Scientific Research

Toulouse, FR