Intern, Architecture Research Engineer (MoE Placement for Serving at Scale)

Samsung Electronics America

San Jose (CA)

On-site

USD 39,000 - 94,000

Part time

21 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Relocation support
Housing stipend
Charitable giving match
Emotional wellness programs
Onsite café and gym

Job summary

Samsung Electronics America is seeking a graduate-level researcher for the AGI Computing Lab in San Jose to tackle MoE placement and scalable ML serving on accelerators. You’ll work closely with hardware and software teams to optimize placement, memory, and interconnect while advancing ML system research and publishing results.

The role emphasizes collaboration, innovation, and independent contribution, with onsite presence in San Jose and a Sr. Director as supervisor.

Qualifications

  • Pursuing graduate degree with research in distributed ML systems or AI hardware.
  • Experience with simulators or performance models for large-scale ML systems.
  • Strong understanding of MoE inference and expert parallelism.
  • Publications in Microarchitecture, Systems, or ML Systems.
  • Familiarity with ML frameworks and serving architectures.

Responsibilities

  • Research expert placement, replication, and migration for MoE serving.
  • Co-optimize expert placement with parallelism, memory, and interconnect.
  • Characterize load imbalance, drift, and cross-layer affinity on real workloads.
  • Extend simulators and DSE tools to model MoE serving and hardware points.
  • Collaborate with compiler/runtime teams to integrate placement-aware scheduling.
  • Contribute to ML systems research and publish papers.
  • Stay updated with ML architectures and LLM serving trends.
  • Perform additional responsibilities as assigned.

Skills

MoE inference
Expert parallelism
Distributed ML systems
GPUs/TPUs/NPUs
PyTorch/JAX
LLM serving frameworks
Optimization methods
Analytical skills
Communication
Teamwork
Learning agility
Collaboration
Innovation

Education

Masters or PhD in CS/EE
1 academic quarter/semester remaining

Tools

PyTorch
JAX
vLLM
SGLang
TensorRT-LLM

Job description

What You’ll Learn
  • Project Overview: MoE placement as a first-class design problem for serving on distributed accelerators at scale.
  • Skills You’ll Learn:
    • Distributed inference and expert parallelism on AI accelerators
    • Design space exploration of large-scale AI serving systems
What You’ll Do

The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique challenges posed by AI/ML workloads and to explore new computing abstractions that can provide a better balance between the hardware and software components of our systems. Additionally, we continuously conduct research and development in emerging technologies and trends across memory, computing, interconnect, and AI/ML, ensuring that our platforms are always equipped to handle the most demanding workloads of the future. By working together as a dedicated and passionate team, we aim to revolutionize the way AI/ML applications are deployed and executed, ultimately contributing to the advancement of AGI in an affordable and sustainable manner. Join us in our passion to shape the future of computing!

Location

Daily onsite presence at our San Jose headquarters in alignment with our Flexible Work policy

Reports to

Sr. Director

  • Research expert placement, replication, and migration for serving Mixture-of-Experts (MoE) models.
  • Co-optimize expert placement with parallelism strategy, memory hierarchy, and interconnect topology.
  • Characterize expert load imbalance, temporal drift, and cross-layer affinity on real workloads.
  • Extend analytical simulators and DSE tools to model MoE serving and evaluate hardware design points.
  • Work closely with the compiler and runtime teams to integrate placement-aware scheduling.
  • Contribute to ML systems and architecture research and write research papers.
  • Stay up-to-date with the latest trends and advancements in ML architectures and LLM serving.
  • Complete other responsibilities as assigned.
What You Bring
  • Pursuing Masters, or PhD in Computer Science or Electrical Engineering preferred.
  • Must have at least 1 academic quarter/semester remaining
  • Research experience in distributed ML systems or AI hardware such as GPUs, TPUs, and NPUs.
  • Published papers in Microarchitecture, Systems, or ML Systems conferences preferred.
  • Experience in developing simulators or performance models for large-scale ML systems.
  • Understanding of system level characteristics of MoE inference and expert parallelism.
  • Familiarity with PyTorch or JAX and LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
  • Background in optimization methods (e.g., integer linear programming or graph partitioning) is a plus.
  • Strong analytical and problem-solving skills
  • Excellent communication and interpersonal skills
  • Ability to work independently and as part of a team
  • You’re inclusive, adapting your style to the situation and diverse global norms of our people.
  • An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding.
  • You’re collaborative, building relationships, humbly offering support and openly welcoming approaches.
  • Innovative and creative, you proactively explore new ideas and adapt quickly to change.
What We Offer

The pay range below is for all roles at this level across all US locations and functions. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience.

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

  • Relocation Support: Live 50+ miles away from your new office? No worries! We'll provide a stipend to help support your move.
  • Housing Stipend: Signing a lease on a new place for your summer internship? We'll help you pay your way with a monthly stipend.
  • Give Back: With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
  • Prioritize Emotional Wellness: With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
  • Stay Fit: Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
  • Embrace Flexibility: Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.
Hourly Base Pay Rate

$28—$68 USD

Equal Opportunity Employment Policy

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Our Commitment to Innovation and Fairness

At Samsung Semiconductor, we use Artificial Intelligence (AI) tools in the recruitment process to enhance efficiency. However, AI is used as a support tool, not a final decision-maker. All hiring decisions are made by our human recruiting team and hiring managers to ensure every candidate is evaluated fairly and holistically.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, Compiler
Staff Engineer, Compiler

Samsung Electronics America • San Jose (CA)

On-site
USD 163,000 - 253,000
4+ weeks PTO
Fertility/adoption stipend
Emotional wellness program
+2
Architecture Research Engineer Intern - Agentic AI Workload Characterization
Architecture Research Engineer Intern - Agentic AI Workload Characterization

Samsung • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Charitable giving match
+2
Intern, Architecture Research Engineer (Agentic AI Workload Characterization)
Intern, Architecture Research Engineer (Agentic AI Workload Characterization)

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+3
Intern, AI Application Engineer
Intern, AI Application Engineer

Samsung Electronics America • Folsom (CA)

On-site
USD 39,000 - 94,000
Relocation stipend
Housing stipend
Volunteer matching
+2
Intern, AI System Architecture Research Scientist
Intern, AI System Architecture Research Scientist

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+1
AI Application Engineer Intern
AI Application Engineer Intern

Samsung • Folsom (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Volunteer/community giving
Intern, Compiler Engineer
Intern, Compiler Engineer

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+3
Technical Director, Large-Scale AI Model Inferencing
Technical Director, Large-Scale AI Model Inferencing

Samsung Semiconductor Inc. • San Jose (CA)

Hybrid
USD 219,000 - 351,000
4+ weeks paid time off
Charitable giving match
Fertility/adoption support
+1
Intern, AI Application Engineer
Intern, AI Application Engineer

Linuxconfig • Folsom (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+3
Technical Director, Large-Scale AI Model Inferencing
Technical Director, Large-Scale AI Model Inferencing

Samsung Electronics America • San Jose (CA)

Hybrid
USD 219,000 - 351,000
4+ weeks PTO
Fertility care stipend
Medical travel support
+1