Research Scientist

XG TECH PTE. LTD.; Singapore; On-site; SGD 75,000 - 110,000; Full time

Job summary

XG TECH PTE. LTD. is seeking a Research Scientist to focus on cutting-edge AI development using AutoResearch for Large Language Models. You will design automated research frameworks to discover and optimize LLM architectures while integrating hardware constraints.

Applicants should have a Master's or PhD in Computer Science, with strong backgrounds in deep learning and AutoML. The role encourages collaboration and innovation at the forefront of technology.

Qualifications

• Master's or PhD degree in a related quantitative field with focus on Deep Learning.
• Strong research background in LLM pre-training and Transformer architectures.
• Hands-on experience with AutoResearch or related tools.
• Solid understanding of GPU/accelerator architectures and parallel training strategies.
• Production-grade coding skills in Python and deep learning frameworks.

Responsibilities

• Design and build automated search and optimization systems for LLM architectures.
• Analyze hardware level constraints and integrate into the optimization loop.
• Scale up architectures for large-scale pre-training.
• Develop accurate evaluation protocols for LLM performance.
• Collaborate with engineers and researchers to optimize efficiency.

Skills

Deep Learning

AutoML

Python

GPU architecture knowledge

Neural Architecture Search

Research publication

Education

Master's or PhD in Computer Science or related field

Tools

Pytorch

JAX

Megatron-LM

Deepspeed

Triton

CUDA

Job description

About Company

Founded in 2022, XG Tech is driving the future of smart vehicles. Its mission is to empower the digital transformation of automobiles, moving from distributed computing to a centralized, cross-domain platform.

XG Tech focuses on the intelligent cockpit—the next frontier of differentiation—while seamlessly integrating advanced driving systems. By reimagining cars as mobile living spaces, XG Tech aligns with the evolving trend of vehicles becoming the “third living space.”

Role Summary

As a Research Scientist (AutoResearch on LLM), you will focus on cutting edge AI-Driven AI development using Autoresearch(Automated MachineLearning) for Large Language Models (LLM). You will design and deploy automated research frameworks that autonomously discover, optimize, and train the next-generation LLM architectures. You will bridge the gap between hardware constraints and model design ensuring that the automatically optimized architectures achieve or exceed the pre‑training efficiency and downstream performance of state of the art established base models.

Key Responsibilities

• Design, build and scale automated search and optimization systems (such as Neural Architecture Search, evolutionary algorithms, or LLM-driven research agents) to autonomously discover optimal LLM architectures.
• Analyze and integrate hardware level constraints (e.g. tensor parallel limits, memory bandwidths, latency, cache hierarchies, FLOPs, and energy efficiency of target silicon) into the optimization loop.
• Scale up discovered architectures to perform large-scale pre‑training. Ensure the final models meet to exceed the performance, training efficiency, and convergence rate of existing top‑tier foundation models.
• Develop accurate, cost effective proxy task, evaluation protocols, and scaling laws to predict full‑scale LLM performance from early‑stage automated search limits.
• Collaborate closely with chip architects, system/compiler engineers, and foundation model researchers to co‑optimize hardware execution efficiency and model training algorithms.
• Stay at the forefront of AutoML, hardware‑software co‑design, and LLM pre‑training literature, contributing to peer‑reviewed publications and IP generation where applicable.

Requirements

• Master's or PhD degree in Computer Science, Electrical Engineering, Applied Mathematics, or a related quantitative field with a focus on Deep Learning.
• Strong research background in LLM pre‑training, Transformer architectures, and scaling dynamics.
• Hands‑on experience with AutoResearch, AutoML, automated optimization algorithms, or using AI agents/LLMs for automated scientific discovery.
• Solid understanding of GPU/accelerator architectures, memory hierarchies, parallel training strategies (tensor, pipeline, data parallel) and hardware performance profiling.
• Production‑grade coding skills in Python and deep learning frameworks (e.g. Pytorch, JAX, Megatron‑LM, Deepspeed).
• Demonstrated experience in training, scaling and evaluating large scaling models from scratch.
• Having first author publications in top tier machine learning or system conferences (e.g. NeurIPS, ICML, ICLR, ASPLOS, ISCA, MLSys) is preferred.
• Experience writing custom kernels (e.g. Triton, CUDA) or working with machine learning compilers is preferred.
• Direct experience working with silicon/chip design teams to customize model architectures for specific ASIC/GPU/FPGA constraints.
• Experience building self‑improving AI loops or automated coding research assistants.

XG Tech is committed to providing equal employment opportunities by country, state, and local laws. XG Tech does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.