Senior/ Machine Learning Engineer (LLM)

Patsnap; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

An innovative firm is seeking a talented machine learning expert to enhance large-scale pre-training language models. This role involves driving research on advanced post-training techniques and optimizing model deployment solutions. You will collaborate with cross-functional teams to leverage LLM capabilities across various business applications, ensuring the company's technical roadmap is aligned with the latest advancements in AI. If you're passionate about pushing the boundaries of NLP and LLMs, this opportunity is perfect for you to make a significant impact in the field.

Qualifications

• 5+ years in machine learning with a focus on NLP and LLMs.
• Strong understanding of transformer architectures and frameworks.

Responsibilities

• Develop and optimize large-scale pre-training language models.
• Collaborate with teams to apply LLM capabilities to business scenarios.

Skills

Machine Learning

Natural Language Processing (NLP)

Programming in Python

Model Optimization

Data Collection and Cleaning

Education

Master's in Computer Science

Ph.D. in AI or related field

Tools

PyTorch

TensorFlow

JAX

Hugging Face

DeepSpeed

Megatron

Job description

Responsibilities

1. Engage in the development and optimization of large-scale pre-training language models, including model architecture design, parallel training strategies, and performance improvements.
2. Drive research and implementation of advanced LLM post-training techniques, including chain-of-thought tuning, preference alignment, and RL for reasoning.
3. Develop and optimize data collection pipelines for model training, including data de-duplication, cleaning, and verification.
4. Design and implement solutions for model deployment, including inference optimization and scaling strategies.
5. Collaborate with cross-functional teams to apply LLM capabilities in various business scenarios, such as materials science.
6. Stay current with the latest developments in the field and contribute to the company's technical roadmap.

Qualifications

1. Master's or Ph.D. in Computer Science, AI, or related field.
2. 5+ years of experience in machine learning, with specific focus on NLP and LLMs.
3. Strong understanding of transformer architectures and modern LLM frameworks (BERT, GPT, T5).
4. Extensive experience with deep learning frameworks (PyTorch, TensorFlow, JAX).
5. Strong programming skills in Python and proficiency with ML tools (Hugging Face, DeepSpeed).
6. Proven track record in training and optimizing large-scale language models (10B+ parameters) is preferred.
7. Experience with distributed training systems (Megatron) and optimization techniques is preferred.