AI Compute Acceleration Engineer — Training & Inference

Beijing Foreign Enterprise Management Consultants Co.,Ltd.; Singapore; On-site; SGD 180,000 - 280,000; Full time

Job summary

Huawei in Singapore seeks an AI Training/Inference Acceleration Algorithm Engineer to lead R&D on acceleration for large-scale models and multimodal domains. You will optimize for next-generation compute architectures, implement algorithms in proprietary and open frameworks, and collaborate across hardware and software teams to achieve peak performance.

Strong track record in LLMs, MoE, and distributed training is required, with expertise in kernel optimization, quantization, memory management,

Qualifications

• Master's or PhD degree in Computer Science, Artificial Intelligence, Electronic Engineering, or a related discipline.
• Solid foundation in mainstream LLM architectures and MoE models with experience in large-scale model training, fine-tuning, or inference deployment.
• Strong hands-on experience in AI acceleration technologies including zero-redundancy optimizers, distributed parallel strategies, communication compression, and memory optimization.
• Technical expertise in high-performance attention kernels and KV-cache compression; experience with weight/activation quantization and sparsity-aware acceleration.
• Proficiency in Python and familiarity with deep learning frameworks; hardware-level kernel optimization or native operator tuning is preferred.
• Understanding of hardware-software co-design and hardware characteristics; track record optimizing performance for 100B+ parameter models.
• Ability to perform complex AI model tuning and optimization in distributed or heterogeneous environments with hardware-aware algorithmic gains.

Responsibilities

• Lead the research and development of AI training and inference acceleration algorithms for Agentic AI and Multimodal domains, optimized for next-generation AI compute architectures.
• Drive end-to-end implementation of acceleration algorithms within proprietary AI frameworks and libraries, ensuring seamless integration and iterative optimization based on performance metrics.
• Oversee technical insight and foresight in training/inference, identifying trends like long-sequence modeling and sparsity to maintain competitive AI computing platforms.

Skills

LLM architectures

MoE models

AI acceleration

Python

Deep learning frameworks

Kernel optimization

Hardware-software co-design

Distributed training

Quantization

Sparsity-aware acceleration

Education

Master's or PhD in CS/AI/EE

Tools

TensorFlow/PyTorch

Job description

Huawei in Singapore seeks an AI Training/Inference Acceleration Algorithm Engineer to lead R&D on acceleration for large-scale models and multimodal domains. You will optimize for next-generation compute architectures, implement algorithms in proprietary and open frameworks, and collaborate across hardware and software teams to achieve peak performance.

Strong track record in LLMs, MoE, and distributed training is required, with expertise in kernel optimization, quantization, memory management,