MoE AI Serving Research Engineer

Samsung Electronics America

San Jose (CA)

Presencial

USD 39 000 - 94 000

Tempo parcial

há 20 horas
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Relocation support
Housing stipend
Charitable giving match
Emotional wellness programs
Onsite café and gym

Resumo da oferta

Samsung Electronics America is seeking a graduate-level researcher for the AGI Computing Lab in San Jose to tackle MoE placement and scalable ML serving on accelerators. You’ll work closely with hardware and software teams to optimize placement, memory, and interconnect while advancing ML system research and publishing results.

The role emphasizes collaboration, innovation, and independent contribution, with onsite presence in San Jose and a Sr. Director as supervisor.

Qualificações

  • Pursuing graduate degree with research in distributed ML systems or AI hardware.
  • Experience with simulators or performance models for large-scale ML systems.
  • Strong understanding of MoE inference and expert parallelism.
  • Publications in Microarchitecture, Systems, or ML Systems.
  • Familiarity with ML frameworks and serving architectures.

Responsabilidades

  • Research expert placement, replication, and migration for MoE serving.
  • Co-optimize expert placement with parallelism, memory, and interconnect.
  • Characterize load imbalance, drift, and cross-layer affinity on real workloads.
  • Extend simulators and DSE tools to model MoE serving and hardware points.
  • Collaborate with compiler/runtime teams to integrate placement-aware scheduling.
  • Contribute to ML systems research and publish papers.
  • Stay updated with ML architectures and LLM serving trends.
  • Perform additional responsibilities as assigned.

Conhecimentos

MoE inference
Expert parallelism
Distributed ML systems
GPUs/TPUs/NPUs
PyTorch/JAX
LLM serving frameworks
Optimization methods
Analytical skills
Communication
Teamwork
Learning agility
Collaboration
Innovation

Formação académica

Masters or PhD in CS/EE
1 academic quarter/semester remaining

Ferramentas

PyTorch
JAX
vLLM
SGLang
TensorRT-LLM

Descrição da oferta de emprego

Samsung Electronics America is seeking a graduate-level researcher for the AGI Computing Lab in San Jose to tackle MoE placement and scalable ML serving on accelerators. You’ll work closely with hardware and software teams to optimize placement, memory, and interconnect while advancing ML system research and publishing results.

The role emphasizes collaboration, innovation, and independent contribution, with onsite presence in San Jose and a Sr. Director as supervisor.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

AI Systems Architecture Research Intern
AI Systems Architecture Research Intern

Samsung • San Jose (CA)

Presencial
USD 39 000 - 94 000
Relocation Support
Housing Stipend
Charitable giving match
+2
Intern, Architecture Research Engineer (MoE Placement for Serving at Scale)
Intern, Architecture Research Engineer (MoE Placement for Serving at Scale)

Samsung Electronics America • San Jose (CA)

Presencial
USD 39 000 - 94 000
Relocation support
Housing stipend
Charitable giving match
+2
Senior Staff AI Systems Performance Engineer
Senior Staff AI Systems Performance Engineer

Samsung Electronics America • San Jose (CA)

Presencial
USD 189 000 - 301 000
4+ weeks paid time off
Fertility/adoption stipend
Medical travel support
+1
AGI Computing Systems Research Intern
AGI Computing Systems Research Intern

Samsung Electronics America • San Jose (CA)

Presencial
USD 39 000 - 94 000
Relocation Support
Housing Stipend
Give Back
+3
Staff ML Compiler Architect for AGI Hardware
Staff ML Compiler Architect for AGI Hardware

Samsung Semiconductor Inc (US) • San Jose (CA)

Presencial
USD 163 000 - 253 000
401k matching
Healthcare benefits
Onsite gym & fitness facilities
+1
Principal AI Memory Architect
Principal AI Memory Architect

Conductor • San Jose (CA)

Presencial
USD 219 000 - 351 000
Medical/Dental/Vision/401k
4+ weeks paid time off
Fertility/adoption support
AI Systems Architecture Intern — Memory & LLM Research
AI Systems Architecture Intern — Memory & LLM Research

Samsung Electronics America • San Jose (CA)

Presencial
USD 39 000 - 94 000
Relocation Support
Housing Stipend
Give Back
+1
ML Compiler Intern: Optimize Deep Learning on Advanced Hardware
ML Compiler Intern: Optimize Deep Learning on Advanced Hardware

Samsung Electronics America • San Jose (CA)

Presencial
USD 39 000 - 94 000
Relocation Support
Housing Stipend
Give Back
+3
Graduate Research Scientist, AI – Energy-Efficient ML
Graduate Research Scientist, AI – Energy-Efficient ML

ARM • Seattle (WA)

Híbrido
USD 120 000 - 180 000
Relocation support
Visa sponsorship
Graduate conferences and events
AI Systems Architecture Research Intern
AI Systems Architecture Research Intern

samsungsemiconductor • San Jose (CA)

Presencial
USD 55 000 - 83 000