AI Research Engineer (Model Compression & Quantization)

Tether; Dublin; On-site; EUR 70,000 - 90,000; Full time

Job summary

Tether is seeking a member of their AI research team to drive innovation in model compression for advanced multimodal AI systems, focusing on efficient deployment of large language models and vision-language models. The role demands expertise in experimental methods such as quantization, distillation, and pruning.

Candidates should possess a PhD in NLP or Machine Learning and have experience with model compression techniques. This position will enhance the performance of AI systems running on resource-constrained devices in Ireland.

Qualifications

• PhD in NLP, Machine Learning, or a related field, complemented by a solid track record in AI R&D.
• Experience with PyTorch deep learning frameworks or equivalent.
• Hands-on experience with model quantization (QAT and PTQ).
• Research experience with knowledge distillation and model pruning.

Responsibilities

• Apply low-bit quantization to reduce model size and latency for generative AI models.
• Leverage knowledge distillation to enable efficient multimodal reasoning.
• Implement pruning techniques for reducing computational overhead.
• Research and apply advanced compression strategies to optimize accuracy-performance balance.
• Document methodologies and publish findings in top-tier conferences.

Skills

Model Compression

Quantization

Knowledge Distillation

Model Pruning

PyTorch

Neural Network Architectures

Education

PhD in NLP, Machine Learning, or related field

Degree in Computer Science or related field

Job description

About the job

As a member of our AI research team, you will drive innovation in model compression and efficient deployment for advanced multimodal AI systems, including large language models (LLMs) and vision-language models (VLMs). Your work will focus on reducing model footprint and computational cost while preserving accuracy, enabling high-performance AI to run efficiently across resource-constrained edge devices. You will apply and advance compression techniques such as quantization, knowledge distillation, and pruning to streamline complex multimodal architectures that integrate text, images, and audio.

We expect you to have deep expertise in model compression methods and a strong background in multimodal model architectures. You will adopt a hands‑on, research‑driven approach to develop, test, and implement novel compression strategies that balance model size, latency, throughput, and accuracy. Your responsibilities include building robust compression pipelines, establishing performance and fidelity metrics, and addressing bottlenecks in production inference. The ultimate goal is to deliver scalable, low‑memory, low‑latency AI systems on edge devices (i.e., smartphones) that maintain high fidelity and tangible real‑world value.

Responsibilities

• Apply low‑bit quantization to reduce model size and inference latency for generative AI models (LLMs, VLMs, multimodal) while maintaining accuracy and output quality.
• Leverage knowledge distillation to transfer capabilities from larger teacher models to smaller student models, enabling efficient multimodal reasoning across text, image, and audio inputs.
• Implement pruning techniques to remove redundant parameters and attention heads, reducing computational overhead without sacrificing task performance.
• Analyze trade‑offs between model efficiency (size, latency, memory) and accuracy across quantization, distillation, and pruning methods; propose improvements based on empirical findings.
• Research and apply mixed‑precision quantization and other advanced compression strategies (e.g., adaptive pruning schedules, distillation with intermediate feature matching) to optimize the accuracy–performance balance.
• Stay current with the latest research in model compression, including emerging techniques for multimodal and generative architectures.
• Document methodologies, experiments, and results clearly to support reproducibility, internal collaboration, and stakeholder communication.
• Author technical papers and publish findings in top‑tier conferences (NeurIPS, ICML, ICLR, CVPR, ACL, AAAI) to advance the field of model compression for multimodal AI.

Qualifications

• A degree in Computer Science or related field. Ideally PhD in NLP, Machine Learning, or a related field, complemented by a solid track record in AI R&D (with good publications in A* conferences).
• Experience with PyTorch deep learning frameworks or equivalent frameworks.
• Hands‑on experience with model quantization including both Quantization‑Aware Training (QAT) and Post‑Training Quantization (PTQ).
• Research and hands‑on experience with knowledge distillation for compressing large models into smaller, efficient ones.
• Research and hands‑on experience with model pruning for compressing large models into smaller, efficient ones.
• Solid understanding of neural network architectures and training processes – Including transformers (e.g., LLMs, VLMs), backpropagation, optimization, and fine‑tuning techniques.
• Familiarity with C++ is a plus (especially for implementing low‑level quantization kernels or inference optimizations).