AI Systems Engineer: LLM Inference on GPU, Flexible

Samsung Electronics America

Folsom (CA)

On-site

USD 39,000 - 94,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Relocation stipend
Housing stipend
Volunteer matching
Wellness program
Gym & on-site cafe

Job summary

Samsung Semiconductor is offering an internship focused on SoC architecture, RTL design, FPGA integration and validation from our San Jose, CA HQ. You will work hands-on on LLM inference, KV cache offloading, and performance benchmarking, collaborating with FPGA, SoC and firmware teams to optimize the data path.

The role emphasizes hands-on RTL design and silicon-focused validation, with mentorship from senior engineers and exposure to cutting-edge storage and memory concepts.

Qualifications

  • Hands-on experience running LLM inference with Python and PyTorch on NVIDIA GPUs under Linux.
  • Understanding of LLM serving internals: KV cache, batching, latency metrics.
  • Experience benchmarking and profiling system performance with scripts (Python, pandas).
  • Familiarity with containerization (Docker/Kubernetes).
  • Pursuing degree with at least 1 academic quarter/semester remaining.

Responsibilities

  • Deploy and operate an LLM inference service on a GPU server.
  • Build automated benchmarks for long-context, multi-turn requests.
  • Configure KV cache offloading to network storage over NVMe‑oF/RDMA.
  • Run daily experiments and document configurations and results in Git.
  • Collaborate with FPGA, SoC, and firmware teams to debug the data path.

Skills

LLM inference
Python
PyTorch
Linux
Serving frameworks

Education

Bachelor’s/Master’s/PhD in CS/CE/EE

Tools

Docker
Kubernetes
vLLM / HuggingFace TGI
NVIDIA GPUs

Job description

Samsung Semiconductor is offering an internship focused on SoC architecture, RTL design, FPGA integration and validation from our San Jose, CA HQ. You will work hands-on on LLM inference, KV cache offloading, and performance benchmarking, collaborating with FPGA, SoC and firmware teams to optimize the data path.

The role emphasizes hands-on RTL design and silicon-focused validation, with mentorship from senior engineers and exposure to cutting-edge storage and memory concepts.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Systems Intern: LLM Inference & SoC Hardware
AI Systems Intern: LLM Inference & SoC Hardware

Samsung • Folsom (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Volunteer/community giving
LLM Inference Intern: GPU, KV Cache & SoC
LLM Inference Intern: GPU, KV Cache & SoC

Linuxconfig • Folsom (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+3
AI Systems Architecture Intern — Memory & LLM Research
AI Systems Architecture Intern — Memory & LLM Research

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back
+1
LLM Inference Engineer - GPU Systems & Optimization
LLM Inference Engineer - GPU Systems & Optimization

GMI Cloud, Inc • San Francisco (CA)

On-site
USD 180,000 - 280,000
AI Systems Performance Intern: Memory & Benchmarking
AI Systems Performance Intern: Memory & Benchmarking

samsungsemiconductor • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Charitable giving match
+3
Senior LLM Inference: GPU Kernel Optimization
Senior LLM Inference: GPU Kernel Optimization

NVIDIA Corporation • Austin (TX)

On-site
USD 184,000 - 287,500
Equity
Benefits
R&D Internship: GPU, SoC & AI Acceleration
R&D Internship: GPU, SoC & AI Acceleration

Samsung Austin Semiconductor, LLC. • Austin (TX)

On-site
USD 53,000 - 88,000
Medical coverage
Dental coverage
Vision coverage
+7
ML/AI Engineer Intern — Hardware & LLM Systems
ML/AI Engineer Intern — Hardware & LLM Systems

llmda Inc. • Santa Clara (CA)

Hybrid
USD 41,000 - 55,000
Medical, dental, vision insurance
Gym on-site
401(k) Retirement Savings Plan
AI Systems Performance Intern — Benchmark & Profiling
AI Systems Performance Intern — Benchmark & Profiling

Samsung Electronics America • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Give Back programs
+2
AI Systems Architecture Research Intern
AI Systems Architecture Research Intern

samsungsemiconductor • San Jose (CA)

On-site
USD 55,000 - 83,000