Intern, AI Systems Performance Engineer

samsungsemiconductor

San Jose (CA)

On-site

USD 39,000 - 94,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Relocation Support
Housing Stipend
Charitable giving match
Emotional wellness program
Fitness center on site
Flexible work environment

Job summary

Samsung Semiconductor is seeking a candidate for a summer internship focused on building and benchmarking AI agent workloads. You will work on servers with Samsung CXL memory expanders and NVIDIA GPUs, evaluating memory systems and performance across CPU, memory, and accelerators.

The role requires pursuing a PhD in a related field and strong programming skills in Python and C/C++ in a Linux environment. This onsite opportunity is based at our San Jose headquarters.

Qualifications

  • Pursuing PhD in CS/CE/EE or related field with strong academic background.
  • Strong programming skills in Python and C/C++ in Linux environments.
  • Solid understanding of computer architecture and memory hierarchy.
  • Experience with performance profiling tools is preferred.
  • Familiarity with AI agent frameworks or benchmarking is a plus.

Responsibilities

  • Build runtime adapters and a trace harness for AI agent frameworks.
  • Develop micro-kernel and end-to-end benchmarks stressing CPU, memory, and GPUs.
  • Profile workloads to analyze latency and memory bandwidth usage.
  • Measure DDR5, HBM, and CXL memory bandwidth across servers.
  • Evaluate memory expansion on Samsung CXL expanders.
  • Present findings and deliver final reports.

Skills

Python
C/C++
Linux environment
Computer architecture
Performance profiling

Education

Pursuing PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field

Tools

perf
eBPF
VTune
Nsight

Job description

Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.

Advancing the World's Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you'll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what's possible and powering the future.

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We're dedicated to empowering people to be their true selves. Together, we're building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Learn

Project Overview: Build AgentSysBench, a benchmark suite and profiling toolchain that measures how AI agent frameworks (Claude Code, Aider, LangGraph) use server resources: host CPU, DRAM, GPU HBM and CXL memory. The results will guide memory system design for future AI data centers.

Skills You’ll Learn
  • Profile system and microarchitecture performance with perf, eBPF, hardware PMUs and NVML/DCGM
  • Characterize memory hierarchies (HBM, DDR5, CXL) and build performance models
  • Benchmark LLM inference serving (vLLM/SGLang) on NVIDIA GPU servers
What You’ll Do

Our team researches the next-generation memory solutions for AI workloads, including HBM, DRAM, and CXL memory expansion. This summer, you’ll work on servers with Samsung CXL memory expanders and NVIDIA GPUs. You’ll see how agentic AI workloads stress memory systems and how those findings feed into future memory product architecture design.

Location: Daily onsite presence at our San Jose headquarters in alignment with our Flexible Work policy

Reports to: Sr. Director

  • Build runtime adapters and a trace record/replay harness for AI agent frameworks
  • Develop micro-kernel and end-to-end agent workload benchmarks that stress CPU, memory, storage and accelerator subsystems
  • Profile agent workloads with perf, eBPF, PMUs and NVML/DCGM to break down per-turn latency and memory bandwidth usage
  • Measure host DDR5, GPU HBM and CXL.mem bandwidth and latency across Intel Xeon and/or AMD EPYC servers
  • Evaluate multi-agent KV-cache sharing and CXL memory expansion on Samsung CXL expanders
  • Build an initial memory tiering cost model (HBM/DDR5/CXL) for long-running MoE agent workloads
  • Present findings in weekly team meetings, then deliver a final report and presentation
  • Complete other responsibilities as assigned.
What You Bring
  • Pursuing PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • Strong programming skills in Python and C/C++ in a Linux environment
  • Solid understanding of computer architecture (CPU caches, the memory hierarchy, NUMA)
  • Experience with performance profiling tools (perf, eBPF, VTune, or Nsight)
  • Preferred: hands-on experience with LLM serving frameworks (vLLM, SGLang) or GPU programming
  • Preferred: familiarity with HBM, CXL, or heterogeneous memory systems
  • Preferred: experience with AI agent frameworks or benchmark development
  • You’re inclusive, adapting your style to the situation and diverse global norms of our people.
  • An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding.
  • You’re collaborative, building relationships, humbly offering support and openly welcoming approaches.
  • Innovative and creative, you proactively explore new ideas and adapt quickly to change.

#LI-AD1

What We Offer

The pay range below is for all roles at this level across all US locations and functions. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience.

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

  • Relocation Support Live 50+ miles away from your new office? No worries! We’ll provide a stipend to help support your move.
  • Housing Stipend Signing a lease on a new place for your summer internship? We’ll help you pay your way with a monthly stipend.
  • Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
  • Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
  • Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Cáfe and gym, plus virtual classes, make it easier.
  • Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Hourly Base Pay Rate $28 - $68 USD

Equal Oppor

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Intern, AI Systems Performance Engineer
Intern, AI Systems Performance Engineer

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back programs
+2
Intern, AI System Architecture Research Scientist
Intern, AI System Architecture Research Scientist

samsungsemiconductor • San Jose (CA)

On-site
USD 55,000 - 83,000
Senior RTL Engineer, Memory Centric Computing
Senior RTL Engineer, Memory Centric Computing

Samsung Electronics America • San Jose (CA)

On-site
USD 138,000 - 206,000
4+ weeks PTO
Onsite Café & gym
Fertility care stipend
+4
Software Engineer - AI Agent Memory Infrastructure San Jose Regular
Software Engineer - AI Agent Memory Infrastructure San Jose Regular

ByteDance • San Jose (CA)

On-site
USD 156,000 - 316,800
Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
+2
Member of Technical Staff, Performance Modeling
Member of Technical Staff, Performance Modeling

Netpreme • Boston (MA)

On-site
USD 140,000 - 230,000
Health, Dental, and Vision for you and
Lunch stipend
EV charging at offices
+1
Technical Director, Large-Scale AI Model Inferencing
Technical Director, Large-Scale AI Model Inferencing

Samsung Semiconductor Inc. • San Jose (CA)

Hybrid
USD 219,000 - 351,000
4+ weeks paid time off
Charitable giving match
Fertility/adoption support
+1
Technical Director, Large-Scale AI Model Inferencing
Technical Director, Large-Scale AI Model Inferencing

Samsung Electronics America • San Jose (CA)

Hybrid
USD 219,000 - 351,000
4+ weeks PTO
Fertility care stipend
Medical travel support
+1
Intern, AI System Architecture Research Scientist
Intern, AI System Architecture Research Scientist

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+1
Senior Staff Performance Engineer
Senior Staff Performance Engineer

samsungsemiconductor • San Jose (CA)

On-site
USD 190,000 - 270,000
Technical Director, Large-Scale AI Model Inferencing
Technical Director, Large-Scale AI Model Inferencing

Conductor • San Jose (CA)

On-site
USD 219,000 - 351,000
Medical/Dental/Vision/401k
4+ weeks paid time off
Fertility/adoption support