LLM AutoML Research Scientist (Hardware-Aware)

XG TECH PTE. LTD.; Singapore; On-site; SGD 75,000 - 110,000; Full time

Job summary

XG TECH PTE. LTD. is seeking a Research Scientist to focus on cutting-edge AI development using AutoResearch for Large Language Models. You will design automated research frameworks to discover and optimize LLM architectures while integrating hardware constraints.

Applicants should have a Master's or PhD in Computer Science, with strong backgrounds in deep learning and AutoML. The role encourages collaboration and innovation at the forefront of technology.

Qualifications

• Master's or PhD degree in a related quantitative field with focus on Deep Learning.
• Strong research background in LLM pre-training and Transformer architectures.
• Hands-on experience with AutoResearch or related tools.
• Solid understanding of GPU/accelerator architectures and parallel training strategies.
• Production-grade coding skills in Python and deep learning frameworks.

Responsibilities

• Design and build automated search and optimization systems for LLM architectures.
• Analyze hardware level constraints and integrate into the optimization loop.
• Scale up architectures for large-scale pre-training.
• Develop accurate evaluation protocols for LLM performance.
• Collaborate with engineers and researchers to optimize efficiency.

Skills

Deep Learning

AutoML

Python

GPU architecture knowledge

Neural Architecture Search

Research publication

Education

Master's or PhD in Computer Science or related field

Tools

Pytorch

JAX

Megatron-LM

Deepspeed

Triton

CUDA

Job description

XG TECH PTE. LTD. is seeking a Research Scientist to focus on cutting-edge AI development using AutoResearch for Large Language Models. You will design automated research frameworks to discover and optimize LLM architectures while integrating hardware constraints.

Applicants should have a Master's or PhD in Computer Science, with strong backgrounds in deep learning and AutoML. The role encourages collaboration and innovation at the forefront of technology.