Applied Research Scientist

Socket.dev; San Jose (CA); Hybrid; USD 150,000 - 200,000; Full time

Job summary

AMD is seeking an Applied Research Scientist in the San Jose/Seattle hybrid model to advance large language and multimodal models. You will design and train LLMs, LMMs, and diffusion-based image/video generation systems, pushing state-of-the-art through novel architectures and training techniques.

Ideal candidates have PhD/MS in ML/CS/AI and strong Python and ML framework experience (PyTorch, JAX, TensorFlow). You will publish results and engage with academia and open-source communities.

Qualifications

• Experience in developing and debugging in Python.
• Experience in ML frameworks such as PyTorch, JAX or TensorFlow.
• Experience with distributed training.
• Expertise on LLM/LMM/Diffusion pretraining, finetuning, and/or RLHF.
• Familiar with transformer architecture.
• Strong communication and problem-solving skills.
• Publication at top-tier venues is a huge plus.

Responsibilities

• Train and finetune LLMs, LMMs, and image/video generation models.
• Improve on the state-of-the-art LLMs, LMMs, and image/video generation models.
• Accelerate the training and inference speed of LLMs, LMMs, and image/video generation models.
• Research novel ML techniques and model architectures.
• Influence the direction of AMD AI platform.
• Publish your work at top-tier venues.
• Engage with academia and open-source ML communities.

Skills

Python

PyTorch

JAX

TensorFlow

Distributed training

LLM pretraining

Finetuning

RLHF

Transformer

Communication skills

Problem solving

Publications

Education

PhD or Master's in ML/CS/AI

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.

The Role

We are looking for an Applied Research Scientist experienced with training large language models, large multimodal models, and image/video generation models. In this role, you will explore novel LLM/LMM and image/video generation architectures and large-scale training techniques to advance the state-of-the-arts. You will be part of a world-class research team working on pre-training, fine-tuning, and aligning large language models, large multimodal models, and image/video generation models, in addition to keeping up-to-date to the latest progress and trends in LLM/LMM, image/video generation, and other foundation models.

The Person

Do you like to design and implement novel research ideas, improve the quality of the large language/multimodal models, accelerate the training and inference speed of LLMs, LMMs, and image/video generation models, and influence future hardware and software direction? If so, this role is for you. The ideal candidate will have expertise and hands-on experience on training LLMs, LMMs, and/or diffusion models., familiar with hyper-parameter tuning techniques, data preprocessing, tokenization methods and latest training approaches for LLMs, LMMs, and diffusion models. A successful candidate needs to be knowledgeable with latest transformer architectures.

Key Responsibilities

• Train and finetune LLMs, LMMs, and image/video generation models.
• Improve on the state-of-the-art LLMs, LMMs, and image/video generation models.
• Accelerate the training and inference speed of LLMs, LMMs, and image/video generation models.
• Research novel ML techniques and model architectures.
• Influence the direction of AMD AI platform.
• Publish your work at top-tier venues.
• Engage with academia and open-source ML communities.

Preferred Experience

• Experience in developing and debugging in Python.
• Experience in ML frameworks such as PyTorch, JAX or TensorFlow.
• Experience with distributed training.
• Expertise on LLM/LMM/Diffusion pretraining, finetuning, and/or RLHF.
• Familiar with transformer architecture.
• Strong communication and problem-solving skills.
• Publication at top-tier venues is a huge plus.

Academic Credentials

• A PhD or master’s degree or equivalent in machine learning, computer science, artificial intelligence, or a related field.

LOCATION

San Jose, CA or Seattle, WA areas preferred (Hybrid).

This role is not eligible for visa sponsorship.

#HYBRID
*Benefits offered are described:*
AMD benefits at a glance.
*AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all the stages of the recruitment and selection process.*
*AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.*
*This posting is for an existing vacancy.*