Nonlinear Computation and Learning over Communication Networks

Eurecom; France; Hybrid; EUR 32,000 - 46,000; Full time

Job summary

Eurecom in France seeks a Postdoctoral researcher to advance distributed nonlinear computation over communication networks. You will design low-complexity coding techniques and analyze fundamental limits, contributing to an ERC Starting Grant project.

The role emphasizes rigorous theory, collaboration with multidisciplinary teams, and mentoring PhD students as part of the SENSIBILITÉ initiative. Start date ASAP on a Postdoctoral CDD contract.

Qualifications

• PhD in Electrical Engineering, Computer Science or Mathematics.
• Strong mathematical background in analysis and linear algebra.
• Motivated to guide PhD students and pursue rigorous research.

Responsibilities

• Design low-complexity coding techniques for computation over networks.
• Explore theoretical limits of communications for computing.
• Publish results and mentor PhD students in ERC project.

Skills

Strong mathematical background

Analytical thinking

Problem solving

Motivated to guide PhD students

Education

PhD in Electrical Engineering, Computer Science, or Mathematics

Job description

Nonlinear Computation and Learning over Communication Networks

Post-Doctoral position M/F (Ref: CS/DM/CompLearn/032026)

The advent of large language models (LLMs), whose unprecedented scale necessitates distributed training and inference, has intensified the need for communication/computation-efficient distributed systems. Particularly, training and inference in LLMs rely on non-linear transformations, most prominently, activation functions and attention mechanisms. Furthermore, many c omputation tasks such as ranking of sources, and compressive sensing across networks, or even modeling the link delay or the probability of outage, as well as precoding for efficient data transmission, are only but a few of the many examples of nonlinear functions of interests over communication networks. For executing them, while parallel computing or replication-based techniques, e.g., MapReduce, and scheduling or pipelining have been exploited, physical constraints, such as bandwidth, power, and routing complexity, hinder their scalability. Devising low-complexity algorithms is formidable as existing coding principles cannot be simply extended to nonlinear computing scenarios. We envision a distributed framework for computing functions of data over communication networks. Our objective is to create a unified framework for distributed non-linear function computation in networks. Looking beyond the current research horizon, we envision a radically new approach to design our framework which involves a careful balance between data, function, and network. We target the emerging frontier research field of distributed functional compression over networks, which capitalizes on finding the shortest length explanation of a function in the number of exchanged communication bits over a network.

While non-linear computation has been extensively studied in contexts such as neural networks, approximation theory, and non-linear optimization, a systematic characterization of the fundamental limits of the distributed computation for non-linear functions remains unexplored. Although existing frameworks, such as matrix factorization, can compute non-linearly separable functions, they typically require a substantial resource overhead. In this project, the Postdoctoral researcher will take a deeper look at distributed computing problems over communication networks, and will explore the theoretical limits of communications for computing. More specifically, the goal of this project is to design low complexity coding techniques for computation over communication networks. This research area brings together tools from information theory and graph theory, and has applications in in edge/cloud computing scenarios, AI, LLMs, task-oriented communication and learning, fundamental limits of computation, decentralized and federated learning, intelligent communication systems, and sensing.

The Postdoctoral position is as part of the ERC Starting Grant supported by the European Research Council (ERC) with a focus on computing nonlinear functions over communication networks (SENSIBILITÉ). The position is intended for talented researchers with the drive to push the knowledge frontiers in the area of advanced wireless networks and LLMs and foundation models that are becoming central enablers for next-generation intelligent systems.

Requirements

• Education Level / Degree: PhD in in Electrical Engineering, Computer Science, or in Mathematics
• Field / specialty: Mathematics, Electrical Engineering, Computer Science, Information Theory
• Other skills / specialties: Strong Mathematical Background in analysis and linear algebra
• Other important elements: Strong Academic and Algorithmic Skills, Motivated and Eager to Solve Problems, Motivated to Establish a Solid Foundational Background, Motivated to Guide PhD Students

S tart date: ASAP
Type of employment contract : Postdoctoral CDD contract