Research Engineer - Speech/Audio Machine Learning

Ifm Us; Paris; Sur place; EUR 70 000 - 95 000; Plein temps

Résumé du poste

Institute of Foundation Models seeks a Research Engineer specializing in speech/audio machine learning to bridge research and production, delivering scalable, low-latency AI systems.

You will optimize compute graphs, apply model compression, build reliable data pipelines for audio datasets, and implement distributed training using DeepSpeed and Horovod, with deployment in Docker and WebRTC integrations.

Qualifications

• MSc or BSc in Computer Science or Software Engineering.
• Engineering Excellence: Strong background in Systems Programming and Computer Architecture.

Responsabilités

• Compute Optimization: Optimize model compute graphs for target runtimes using frameworks such as TensorRT, Apache TVM, or OpenVINO.
• Model Compression: Perform quantization (INT8/FP8) and pruning for real-time execution on edge or cloud GPUs.
• Data Orchestration: Build reliable data pipelines for audio datasets, including automated denoising and synthetic data augmentation.
• Distributed Training: Help design efficient multi-node training scripts using frameworks such as DeepSpeed, Horovod, as well as other distributed training technologies.
• Deployment: Build and maintain high-performance demo environments on the cloud using Docker and standalone model serving frameworks. Integrate WebRTC for real-time audio-to-audio interactions.

Connaissances

Compute optimization

Model compression

Data orchestration

Distributed training

Deployment

Formation

MSc or BSc in Computer Science or Software Engineering

Outils

TensorRT

Apache TVM

OpenVINO

DeepSpeed

Horovod

Docker

WebRTC

Description du poste

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

As a Research Engineer specializing in speech/audio machine learning, you will bridge the gap between research and production constraints to deliver competitive performance. You will be responsible for the end-to-end performance of our machine learning speech systems, from architecting scalable training infrastructure to achieving extreme low-latency inference.

Responsibilities

• Compute Optimization: Optimize model compute graphs for target runtimes using frameworks such as TensorRT, Apache TVM, or OpenVINO.
• Model Compression: Perform quantization (INT8/FP8) and pruning to enable real-time execution on edge or cloud GPUs.
• Data Orchestration: Build reliable data pipelines for audio datasets, including automated denoising and synthetic data augmentation.
• Distributed Training: Help design efficient multi-node training scripts using frameworks such as DeepSpeed, Horovod, as well as other distributed training technologies.
• Deployment: Build and maintain high-performance demo environments on the cloud using Docker and standalone model serving frameworks. Integrate WebRTC or similar bidirectional protocols to ensure seamless, real-time audio-to-audio interactions.
• MSc or BSc in Computer Science or Software Engineering.
• Engineering Excellence: Strong background in Systems Programming and Computer Architecture.